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ABSTRACT 


Analysis  of  transportation  systems  for  planning  purposes  is  a 
process  which  includes  several  distinct  steps.  The  analyst  must 
search  for  an  initial  set  of  alternative  actions,  predict  the 
impacts  of  each  alternative,  and  evaluate  the  impacts  according  to 
one  or  more  sets  of  assumed  goals.  He  must  then  decide  whether  to 
implement  the  best  action  he  has  found  thus  far  or  to  search  for  new 
alternatives.  The  process  continues  until  the,  analyst  finds  a 
.satisfactory  alternative,  or  analytic  resources  (time,  dollars)  are 
exhausted. 

A  variety  of  sets  of  predictive  models  are  currently  available 
which  predict  the  in pacts  of  alternative  transportation  systems. 

However,  little  has  been  done  to  provide  systems  for  evaluating 
these  impacts  and  comparing  the  alternatives  on  the  basis  of  the 
evaluations.  Evaluation  and  comparison  of  alternatives  is  complicated 
for  two  reasons:  the  predictive  models  generate  large  quantities  of 
impact  data;  and  there  are  many  different  types  of  impacts  which, 
though  seemingly  incommensurable,  must  be  compared, 

DODOTRAKf.  is  a  problem-oriented  computer  language  designed  to 
permit  an  analyst  to  define  actions,  to  predict  the  consequences  or 
impacts  of  these  actions,  to  evaluate  the  impacts  conditional  upon  a 
statement  of  goals  formulated  as  utilities,  and  to  compare  and  rank 
the  actions,  based  upon  the  results  of  the  evaluations. 

The  purpose  of  this  research  was  to  design  and  implement  additional 
capabilities  for  impact  evaluation  and  comparison  in  the  DODOTRANS 
system.  Two  guiding  objectives  in  the  development  of  these  capabilities 
wex-e:  the  inclusion  of  a  variety  of  impact  data  types  in  the  evalua¬ 

tion  process}  and  the  ability  to  perform  parametric  analyses  over  sets 
of  actions,  parameters,  consequences  and  utilities.  The  information 
retrieval  routines  implemented  to  achieve  these  capabilities  were 
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designc.d  in  a  nodular  fashion.  This  makes  possible  the  Incorporation 
of  new  data  types  in  the  evaluation  arid  comparison  procedures  whenever 
they  become  available.  The  retrieval  routines  also  provide  a  necessary 
support  for  the  future  addition  of  general  capabilities  for  graphical 
display  or  statistical  analysis. 
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BACKGROUND 


1 . 1  Introduction 

The  Transportation  Systems  Division  of  the  M.I.T.  Department  of 
Civil  Engineering  has  been  developing  techniques  for  the  analysis  of 
transportation  systems  alternatives  for  the  U.S.  Department  of  Trans¬ 
portation.  The  task  of  the  initial  research  project,  entitled  Search 

and  Choice  in  Transport  Systems  Planning,  was  to  design  and  carry  out 

♦ 

a  prototype  analysis  which  demonstrated  the  use  of  a  computer-based 
analysis  for  predicting  the  equilibrium  between  supply  and  demand  in 
a  multimodal  transportation  system,  [8,14]^  A  follow-up  research 
project,  entitled  Techniques  for  Searching  Out  Transportation  Systems 
Alternatives,  has  extended  and  tested  the  techniques  provided  by  the 
initial  project. 

Analysis  of  transportation  systems  for  planning  purposes  requires 
the  integration  of  a  variety  of  analytical  techniques.  The  demand  for 
transportation  must  be  predicted  at  several  levels,  ranging  from  the 
aggregate  demand  by  all  modes  between  regions  separated  by  hundreds  or 
thousands  of  miles,  to  detailed  demands  on  specific  routes  or  links  in 
a  transportation  network.  The  supply  of  transportation  services  must 
be  modelled  at  similar  levels  so  that  the  demand  for  transportation  can 
be  related  to  the  supply  in  a  network  equilibrium  computation. 

The  generalized  transportation  "problem"  concerns  the  prediction 
of  the  demand  for  transportation  services,  along  with  the  corresponding 


*See  Bibliography  for  references  in  brackets. 
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characteristlc9  of  supply  which  will  satisfy  that  demand.  Analyses 
which  recognize  the  interdependence  of  supply  and  demand  in  transporta 
tlon  while  searching  for  solutions  to  the  transportation  problem  are 
called  equilibrium  analyses.  (6] 

The  prototype  analysis  system  developed  by  the  Search  and  Choice 
research  project  is  a  problem-oriented  computer  language  called 
TRANSET  11.  TRANSET  II  Is  one  of  many  subsystems  of  ICES  [11,12] 
(Integrated  Civil  Engineering  System)  developed  by  the  M.I.T.  Depart¬ 
ment  of  Civil  Engineering  for  the  solution  of  civil  engineering 
problems.  Other  subsystems  have  been  designed  to  solve  problems  in 
structural  analysis  and  design,  soils  analysis,  bridge  design,  and 
highway  design. 

A  single  run  of  the  TRANSET  II  system  of  models  produces  large 
amounts  of  data.  As  anticipated,  as  TRANSET  II  was  used  for  analyses 
of  transport  alternatives  [13],  it  was  found  that  analysis  of  one  or 
several  runs  required  laborious  inspection  of  many  pages  of  output. 

The  evaluation  of  the  consequences  or  impacts  of  even  a  single  trans¬ 
portation  alternative  was  very  difficult  due  to  the  quantities  of 
unstructured  consequence  data  produced  by  the  analyses.  It  was  clear 
that  additional  capabilities  were  needed  in  TRANSET  II  to  aid  in  the 

evaluation  of  impacts  and  the  selection  of  the  best  alternative. 

2 

Follansbee  summarized  the  problem  thus: 

1.  An  analysis  of  one  transportation  alternative  produces 
large  volumes  of  data. 


2 

Follansbee,  K.  G. ,  A  Prototype  Information  System  for  the 
Prob lem-Solvlnp,  Process  Model. 
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2.  The  development  of  a  real-world  transportation  plan  or 
policy  which  can  be  implemented  requires  more  than  Just 
the  prediction  of  impacts  of  one  or  two  alternatives. 

3.  The  differences  and  similarities  of  the  predicted  impacts 
for  all  alternatives  should  be  determined  to  aid  in  the 
choice  of  an  alternative. 

4.  The  predicted  impacts  of  each  alternative  are  sensitive  to 
changes  in  the  exogenous  parameters  of  the  predictive 
models . 

5.  Different  alternatives  may  accomplish  the  same  goals  but 
affect  different  groups  in  the  region. 

6.  The  degree  to  which  any  alternative  achieves  the  goals 
is  sensitive  to  the  utilities  (the  parameters  of  evalua¬ 
tion),  and  the  parameters  of  the  predictive  models. 

Thus,  the  need  for  sensitivity  analysis  compounds  the 
problem  of  choice. 


An  example  of  a  problem  in  transport  systems  analysis  will  be 
introduced  here  to  illustrate  some  of  the  issues  stated  above.  The 
actual  analysis  will  be  described  in  Chapter  4.  The  purpose  of  the 
example  at  this  point  is  to  indicate  the  nature  and  magnitude  of  the 
problems  faced  by  the  transport  systems  analyst,  particularly  in  the 
evaluation  process. 


1. 2  Example  of  Analysis  of  Transport  Systems 

Consider  the  problem  of  implementing  a  VTOL  (Vertical  Take-Off 
and  Landing)  air  travel  system  in  the  megalopolitan  area  from  Southern 
New  Hampshire  to  Washington,  D.C.  extending  inland  to  Appalachia.  The 
problem  1b  to  choose  a  strategy  for  implementing  VTOL  service  between 
a  fixed  number  of  terminals  in  three  stages,  resulting  in  direct  flights 
between  all  terminals  at  t'u  inclusion  of  the  third  stage. 
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The  area  of  Interest,  commonly  referred  to  as  the  Northeast 
Corridor,  will  be  divided  into  five  districts  for  this  analysis.  This 
Is  a  very  coarse  breakdown,  but  it  will  suffice  to  demonstrate  the 
problems  and  techniques  encountered  In  transport  systems  planning. 

The  five  districts  are  defined  below: 

1.  Washington  and  Baltimore 

2.  Philadelphia,  Atlantic  City,  Wilmington,  and  Trenton 

3.  New  York  City 

U.  Hartford,  New  Haven,  and  Springfield 

5.  Boston,  Worcester,  and  Providence 

Four  modes  of  travel  will  be  considered  in  the  analysis:  auto, 
rail,  conventional  air,  and  VTOL. 

Three  strategies  will  be  proposed  for  Implementing  a  fully- 
connected  VTOL  system  In  three  stages.  The  stages  occur  in  1970, 

1975,  and  1980,  respectively.  Figures  1.1,  1.2,  1.3  and  are  diagrams 
of  the  three  strategies.  Each  line  in  these  figures  represents  VTOL 
service  in  both  directions  between  the  districts  connected  by  the  line. 

Each  strategy  consists  of  three  actions,  corresponding  to  the 
implementation  of  VTOL  service  over  certain  routes  in  the  system. 

Since  there  are  three  strategies,  there  are  nine  actions  which  must 
be  described  and  analyzed.  In  addition,  it  is  necessary  to  define  two 
additional  actions  which  correspond  to  the  system  in  1960  and  1965 
when  no  VTOL  service  is  available.  These  actions  are  necessary  bzr  <es 
the  predictive  model  used  to  predict  population,  per  capita  income, 
and  regional  output  for  each  district  in  the  system  requires  data  from 
two  points  in  time  in  order  to  predict  data  for  a  third  point.  The 
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population,  per  capita  income  and  regional  output  of  each  district  are 
impacts  which  must  be  evaluated  for  each  stage  of  each  strategy.  The 
addition  of  actions  in  1960  and  1965  which  are  essentially  null 
actions  (because  no  VIOL  implementation  occurs)  permits  the  system 
of  models  to  predict  these  impacts  for  the  year  1970.  Therefore,  a 
total  of  eleven  actions  must  be  defined  for  this  analysis. 

1.2.1  Definition  of  Actions 

A  variety  of  data  must  be  collected  to  define  each  action  in  the 
analysis.  Each  mode  of  travel  is  modelled  as  a  series  of  links  and 
nodes,  connecting  districts  in  a  manner  which  approximates  the  route 
structure  of  each  mode  in  the  real-world  system.  The  rail  mode  is 
modelled  as  a  linear  system  with  line  haul  links  connecting  adjacent 
districts  only.  The  road  system  is  modelled  in  a  similar  fashion  with 
the  addition  of  by-pass  links  which  permit  travelers  to  avoid  passing 
through  the  center  of  the  New  York  and  Philadelphia  districts.  The 
air  mode  has  direct  line  haul  links  connecting  every  district  to  every 
other  district. 

In  addition  to  the  links  representing  line  haul  travel,  other  links 
are  included  in  the  models  which  represent  travel  between  the  initial 
origin  (home,  office,  etc.)  and  the  terminal  (for  air  and  rail  modes). 
Other  links  are  Included  to  model  the  movements  through  a  terminal  to 
board  a  train  or  plane.  Similar  links  are  included  for  travel  at  the 
destination  district  from  the  terminal  to  the  ultimate  destination.  In 
summary,  every  segment  of  the  total  trip  from  one  district  to  another 
which  contributes  a  significant  impact  to  the  trip  in  terms  of  time, 
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money  or  any  other  measure  is  included  as  a  separate  link  or  links  in 
the  models  cf  each  mode.  Links  must  also  be  added  to  represent  the 
VTOL  mode  as  service  becomes  available  in  each  stage  of  each  strategy. 

I.ven  though  we  are  using  a  simplified  five-district  model  of  the 
Northeast  Corridor,  over  175  links  are  required  to  model  all  modes  of 
travel.  each  link  must  be  described  with  respect  to  its  length,  capa¬ 
city,  and  level  of  service.  Level  of  service  is  described  by  a  supply 
function  which  establishes  a  relationship  between  the  travel  volume 
and  average  speed  on  a  link.  The  analyst  must  collect  over  500  items 
of  data  in  order  to  describe  the  175  links  used  in  the  network  model 
for  each  action. 

The  next  step  in  the  analysis  is  to  collect  data  on  each  district 
for  1960  and  1965.  The  required  data  includes  population,  per  capita 
income,  and  the  holding  capacity  (or  upper  bound  on  population)  for 
each  district.  The  predictive  models  will  predict  these  data  for  each 
of  the  VTOL  stages.  The  district  data  for  each  action  contains  15 
items. 

Finally,  data  which  describes  the  operating  characteristics  of 
each  mode  must  be  collected.  This  data  includes  the  fare  and  frequency 
of  service  over  each  route  for  each  mode,  the  subsidy  available  to  each 
mode,  the  tax  rate  imposed  upon  fares,  and  the  fixed  and  variable  costs 
incurred  by  each  mode.  Even  though  not  all  of  these  data  apply  to  all 
modes  (no  direct  subsidy  to  the  road  mode)  there  are  over  200  mode 
data  items  to  be  collected  for  every  action  in  this  analysis.  This 
task  is  made  easier  by  the  fact  that  much  cf  this  data  is  assumed  to 
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be  the  same  over  several  or  even  all  of  the  actions.  However,  the 
potential  exists  for  the  collection  of  11  *  200  ■  2200  data  items  for 
this  one  category  alone. 

All  of  the  data  described  above  are  inputs  to  the  predictive 
models  (with  the  exception,  of  course,  of  the  district  data  for  stages 
1970,  1975,  and  1980).  Since  a  total  of  about  750  data  elements  are 
required  to  describe  each  action,  the  11  actions  in  this  analysis 
include  over  8000  pieces  of  descriptive  data.  The  potential  diffi¬ 
culties  in  evaluating  and  comparing  actions  are  apparent  even  before 
the  consequences  or  impacts  of  each  action  are  predicted. 

1.2.2  Prediction  of  Consequences 

The  prediction  of  the  consequences  of  each  action  is  a  straight¬ 
forward  procedure.  The  decisions  regarding  which  consequences  to 
predict  are  for  the  most  part  constrained  by  the  design  capabilities 
of  the  predictive  models.  The  types  of  impacts  generated  by  the 
predictive  models  for  each  action  include  the  following: 

1.  Volumes  of  travel  over  each  route  by  each  mode. 

2.  Travel  times  over  each  route  by  each  mode. 

3.  Volumes  of  travel  over  Individual  links  in  the  network  model 
of  each  mode. 

4.  Travel  times  over  eao.  link  in  the  network  model  of  each  mode. 

5.  RelaMve  measures  of  accessibility  of  each  district  for  each 

mode. 

6.  District  growth  measures,  including  population,  income,  and 


total  regional  product. 
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The  travel  time  and  travel  volume  files  alone  include  over  400 
data  items  For  each  set  of  impacts.  All  told,  over  500  impacts  are 
predicted  for  each  action.  The  11  actiono  in  this  analysis  include 
over  5500  impacts  which  must  be  compared  and  evaluated  before  the  best 
strategy  can  be  selected.  Including  the  8000  data  items  used  to 
describe  each  action,  there  are  over  13000  data  items  which  must  be 
evaluated  before  a  strategy  can  be  chosen. 

1.2.3  Evaluation  of  Consequences 

A  vital  step  in  the  evaluation  of  the  consequences  of  each  action 
is  the  identification  of  all  actors  who  are  impected  by  the  consequences. 
Examples  of  actors  impacted  by  a  new  VTOL  system  are  the  following: 

1  -  Travelers  between  various  districts  in  the  system 

2  ~  Operators  of  the  rail,  VTOL  and  conventional  air  modes 

3  -  Residential  areas  affected  by  noise  levels  and  land  acquired 

for  terminal  construction 

4  -  Commercial  interests  affected  by  noise,  pollution,  or  land- 

taxings 

5  -  Political  bodies  at  ft-dert?.,  state,  and  local  level  involved 

in  selection  of  routes,  levying  of  taxes  on  fares,  awarding 

of  subsidies,  etc. 

3 

When  all  relevant  actors  have  been  identified,  an  impact  matrix 
can  be.  constructed  which  arrays  actors  against  impacts.  Operations 
can  be  performed  upon  the  impact  matrix  which  will  condense  the 

3 

Manheio,  M.  L. ,  et  al. ,  The  Impacts  of  Highways  Upon  Environ¬ 
mental  Value s . 
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inf  omation  and  display  Che  significanC  issues.  The  goal  of  these 
operations  is  a  ranking  of  the  actions.  Four  basic  operations  upon 
an  impact  matrix  can  be  defined  as  follows: 

1  -  Define  goal  variables 

2  -  Compute  values  of  goal  variables 

3  -  Explore  and  compare  values  of  goal  variables 

A  -  Obtain  "final"  ranking 

The  definition  of  goal  variables  involves  the  aggregation  of 
impacts  into  a  measure  which  reflects  more  clearly  the  relative 
achievement  of  a  particular  goal.  A  complete  goal  variable  definition 
is  comprised  of  the  Impacts  or  lower  order  goals  included  as  components , 
and  the  operation  required  to  compute  a  value  of  the  variable  given 
values  for  the  components. 

Computation  of  the  value  of  a  goal  variable  Involves  the  specifi¬ 
cation  of  a  particular  set  of  consequences  and  a  particular  set  of 
links,  routes,  districts,  or  modes  over  which  the  evaluation  is  to 
take  place.  Impacts  can  be  classified  by  the  manner  in  which  individual 
impacts  are  specified  out  of  a  large  set  of  similar  Impacts.  Inter- 
dlstrlct  travel  times  are  specified  by  stating  an  origin  district, 
destination  district,  and  mode  of  travel.  Link  volumes  are  specified 
by  seating  an  origin  node  and  a  destination  node.  District  populations 
are  specified  simply  by  stating  the  district  name.  These  classifica¬ 
tions  are  called  data  classes.  The  descriptors  indicating  which 
routes,  links,  districts  or  modes  are  included  in  the  evaluation  are 
called  the  range  specification. 
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Exploration  and  comparison  of  the  values  of  a  given  goal  variable 
is  done  by  ranking  all  actions  according  to  the  values  of  a  particular 
goal  variable  conditional  upon  a  set  of  partial  utilities.  Parametric 
analyses  over  a  range  of  parameters  for  the  predictive  models  or  a 
range  of  utilities  are  performed  to  determine  the  sensitivity  of  the 

rankings  to  uncertainty  in  the  prediction  and  evaluation  processes. 

4 

If  a  goal  variable  is  defined  as  a  linear  scoring  function  with 
several  components  weighted  to  form  a  single  total,  one  form  of 
comparison  or  exploration  would  be  to  determine  the  values  of  the 
weights  in  the  linear  scoring  function  such  that  two  or  more  alterna¬ 
tives  had  equal  or  nearly  equal  values  of  the  goal  variable. 

The  selection  of  a  final  ranking  is  done  cfter  many  explorations 
and  comparisons  of  the  results  of  goal  variable  evaluation  have  been 
performed. 

It  should  be  stressed  here  that  evaluation  is  not  a  one-pass 
procedure.  The  results  of  an  evaluation  may  prompt  the  analyst  to 
formulate  new  goal  variables  which  must  be  evaluated  and  compared  over 
a  set  of  alternatives.  He  may  even  decide  to  create  a  new  alternative 
for  which  consequences  must  be  predicted  and  evaluated. 

1. 3  The  DODOTRANS  Language 

The  problem  described  in  this  chapter  was  analyzed  with  the  aid 
of  a  new  computer  language  called  DODOTRANS.  This  language  is  the 

4 

See  Chapter  2  for  the  definition  of  a  linear  scoring  function. 
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result  of  several  stages  of  software  development  which  began  with  the 
TRANSET  I  system.  (13]  TRANSET  I  was  created  prior  to  the  prototype 
analysis  effort  in  1967-68.  It  consisted  primarily  of  a  route 
selection  model  for  single  mode  systems.  TRANSET  II  extended  TRANSET 

I  to  Include  demand  prediction  and  route  selection  for  a  multimodal 
system.  Follansbee  was  the  originator  of  a  language  based  on  TRANSET 

II  which  was  called  DODO  (Decision-Oriented  Data  Organiser).  [3]  DODO 
included  all  of  the  predictive  capabilities  of  TRANSET  II,  as  well  as 
an  evaluation  capability  based  on  the  concept  of  a  multidimensional 
goal  fabric  proposed  by  Hall  and  Manheim. 5  DODO  permitted  the  user  to 
structure  his  analyses  so  that  a  permanent  record  was  maintained  of  the 
entire  analytical  process.  Furthermore,  DODO  provided  a  limited  set  of 
capabilities  for  defining  and  evaluating  goal  variables  which  facili¬ 
tated  the  evaluation  of  impacts  of  several  transportation  alternatives. 
The  DODOTRANS  language  represents  the  current  state  of  the  system  of 
models  which  began  with  TRANSET  I.  Numerous  chenges  have  been  made 
from  DODO  in  both  the  prediction  and  evaluation  of  the  impacts  of 
alternative  transport  systems. 

The  goal  of  the  research  reported  here  was  to  expand  the  evaluation 
capabilities  of  DODO.  Subsequent  chapters  of  this  report  describe  the 
evaluation  process  in  transport  systems  analysis,  indicate  the  extent 
to  which  DODO  automated  that  process  and  describe  the  extensions  to 
DODO  that  were  implemented  as  part  of  this  research.  Then  these  new 

^Hall,  Frederick,  and  M.  L.  Manheim,  Abstract  Representation  of 
Goal  Structures. 
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capabilities  are  illustrated  for  the  VTOL  example  outlined  above. 
Finally,  conclusions  on  the  effectiveness  of  the  new  capabilities  are 
made,  including  recommendations  for  future  developments  in  DO DOT RAN S . 


2. 


EVALUATION  IN  TRANSPORT  SYSTEMS  PLANNING 


2. 1  Introduction 

This  chapter  contains  a  discussion  of  evaluation  methodology, 
including  a  description  of  several  evaluation  techniques  which  have 
been  used  in  transport  systems  planning.  The  evaluation  capabilities 
provided  by  the  TRANSET  II  and  DODO  computer  languages  are  also 
discussed. 

2. 2  Evaluation  Methodology 

Let  us  consider  the  requirements  which  any  evaluation  technique 
used  for  transport  systems  planning  must  satisfy.  A  report  prepared 
by  the  M. I.T.  Urban  Systems  Laboratory  for  the  National  Cooperative 
Highway  Research  Program  of  the  liighway  Research  Board  includes  a 
detailed  discussion  of  the  role  of  evaluation  in  highway  location. ^ 
Though  highway  location  analysis  and  the  analysis  of  inter-city  travel 
demands  employ  different  techniques  to  predict  impacts  and  evaluate 
alternatives,  the  general  role  of  evaluation  is  common  to  both  problems. 
Much  of  the  discussion  of  evaluation  methodology  presented  in  this 
chapter  is  based  upon  a  similar  discussion  in  the  NCHRP  report. 

2. 3  Evaluation  Strategies  and  Techniques 

The  NCHRP  report  distinguishes  between  determining  an  evaluation 
strategy  and  an  evaluation  technique.  The  broader  of  the  two  problems 

Slanheim,  M.  L.,  et  al.  ,  The  Impacts  of  Highways  Upon  Environ- 
mental  Values. 
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ls  Che  determination  of  an  evaluation  strategy.  This  problem  involves 
deciding  how  and  from  what  information  an  impact  matrix  should  be 
constructed.  '.Vhen  these  questions  have  been  answered,  the  impact 
data  available  for  evaluation  is  known.  It  then  becomes  a  lesser 
problem  to  choose  an  evaluation  technique  which  will  operate  upon  the 
impact  matrix  to  produce  a  ranking  over  a  fixed  set  of  actions.  Th*s 
research  is  concerned  primarily  with  the  problem  of  providing  evalua¬ 
tion  techniques  for  the  transport  systems  analyst.  The  impact  data 
available  for  evaluation  has  been  determined  for  the  most  part  by  the 
predictive  models  in  DODOTRANS. 

An  evaluation  method  (strategy  and  technique)  must  perform  three 
functions.  It  must: 

1.  Produce  a  ranking  of  the  alternatives. 

2.  Suggest  areas  of  search  for  new  alternatives. 

3.  Identify  the  crucial  tradeoffs,  i.e.,  present  versus  future 
Impacts  or  Che  gains  of  one  actor  versus  losses  of  another. 

The  evaluation  method  must  also  be  able  to  reflect  the  preferences 
of  several  different  interest  groups  or  combination  of  interest  groups. 
These  groups  may  include  the  following: 

1.  The  users  of  the  transportation  system. 

2.  The  operators  of  the  system. 

3.  Residential  and  commercial  interested  affected  by  the 
acquisition  of  land  for  rights-of-way,  noise  levels,  and 
visual  changes  in  their  environment. 
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4.  Political  bodies  at  federal,  state,  and  local  levels. 

The  decision  makers  Involved  in  the  planning  process  may  request 
that  alternative  actions  be  ranked  according  to  each  of  several  sets 
of  preferences  corresponding  to  different  interest  groups  such  as  the 
ones  stated  above.  They  might  also  request  that  the  preferences  of 
several  groups  be  combined  into  a  single  statement  of  preferences  by 
assigning  weights  to  the  preferences  of  each  group.  An  effective 
evaluation  method  should  provide  capabilities  for  the  statement  of 
preferences  and  modification  of  these  preferences  as  the  analysis  of 
alternatives  proceeds. 

2.4  Different  Evaluation  Techniques^ 

A  number  of  evaluation  techniques  have  been  used  in  transportation 
planning.  Four  of  these  techniques  are  listed  below: 

1.  linear  scoring  functions 

2.  utility  theory 

3.  cost-benefit  analysis 

4.  goal  fabric  analysis 
2.4.1  Linear  Scoring  Function 

A  linear  scoring  function  technique  assumes  that  impacts  or 
indicators  can  be  quantified  and  assigned  a  numerical  weight.  Rankings 
are  produced  by  computing  the  weighted  sum  of  all  indicators  for  each 


7 


Manheim,  et  al. ,  op.  cit. , 
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alternatlve.  Linearity  and  value-wise  independence  of  indicators  are 
properties  of  linear  scoring  functions. 

The  major  advantage  of  using  a  linear  scoring  function  is  that  it 
provides  an  unambiguous  measure  of  the  total  value  of  an  alternative 
which  can  be  applied  to  a  wide  range  of  alternatives  in  an  efficient 
manner.  The  major  disadvantages  are  the  danger  of  Inaccurate  weights 
leading  to  the  recommendation  of  bad  alternatives,  and  the  problem  of 
neglecting  all  impacts  which  were  not  incorporated  directly  into  the 
function. 

2.4.2  Utility  Theory 

Utility  theory  assumes  that  a  general  relationship  exists  which 
relates  individual  Impacts  to  their  composite  value.  The  linear 
scoring  function  is  a  special  case  of  a  general  utility  function;  in 
the  linear  scoring  function  the  relative  utilities  are  constant. 
Utility  theory  has  the  same  advantages  and  disadvantages  as  the  linear 
scoring  function.  The  difference  in  the  two  is  simply  the  added 
accuracy  of  more  complex  functional  forms  provided  by  general  utility 
functions,  achieved  with  an  added  cost  in  the  computation  of  the  score 
for  different  alternatives. 

2.4.3  Cost-Benefit  Analysis 

Cost-benefit  analysis  assumes  that  all  impacts  relevant  to  the 
ranking  of  alternatives  can  be  assigned  dollar  values  and  combined 
into  a  total  cost  and  total  benefit  for  each  alternative.  This 
method  has  the  advantage  of  allowing  impacts  to  be  added  or  deleted 
from  the  analysis  in  a  straightforward  manner.  Disadvantages  include 
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a  tendency  by  analysts  to  omit  Impacts  which  are  not  easily  assigned 
a  dollar  value  in  favor  of  those  Impacts  which  are  more  readily  priced. 
There  Is  also  the  danger  of  misinterpretation  of  the  coats  and  benefits 
with  respect  to  whose  dollars  are  used  and  when  they  are  payed  out 
or  received. 

2.4.4  Goal  Fabric  Analysis 

This  technique  Is  a  method  for  structuring  the  goals  of  a  system 
to  show  their  relationships  to  one  another.  Pour  relations  are  defined: 
specification,  means-end,  value-wise  dependence,  and  value-wise  inde¬ 
pendence. 

Specification  refers  to  a  set  of  goals  which  define  explicitly  a 
more  general  goal.  The  means-end  relation  signifies  that  one  goal  is 
a  means  to  achieve  another  goal.  Value-wise  dependent  goals  are  those 
which  can  be  evaluated  only  in  conjunction  with  other  goals.  Value- 
wise  independent  goals  can  be  evaluated  individually. 

These  relationships  can  be  used  to  structure  goals  as  an  inter¬ 
woven  tree  with  the  general  goals  at  the  top  and  the  most  specific 
goals  at  the  bottom.  The  specific  goals  are  directly  related  to  the 
impacts  which  can  be  predicted  for  each  alternative  under  considera¬ 
tion. 

Evaluation  proceeds  from  the  base  of  the  tree  to  the  highest 
levels  by  checking  for  dominance  of  an  alternative  for  all  goals 
comprising  a  higher-level  goal.  When  dominance  cannot  be  established, 
the  analyst  must  choose  the  best  alternative  in  a  subjective  manner 
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based  on  Che  values  of  chose  goals  which  he  feels  are  most  important. 

He  may  be  aided  by  the  use  of  a  linear  scoring  function  employing  a 
subset  or  all  of  the  goals  at  a  given  level.  He  may  also  compare  the 
intervals  between  alternatives  on  each  goal  to  aid  him  in  his  decision. 

Coal  fabric  analysis  allows  several  evaluation  techniques  to  be 
combined  in  a  single  analysis.  Not  all  goals  have  to  be  quantified,  as 
in  the  case  of  the  other  three  techniques  discussed  above.  Its 
relational  and  hierarchical  structure  also  provides  a  means  for 
graphically  displaying  the  structure  of  the  goal  fabric. 

Disadvantages  of  goal  fabric  analysis  Include  the  difficulty  of 
evaluating  the  performance  of  alternatives  on  higher  level  goals  and 
the  difficulty  in  specifying  tradeoffs  between  goals  which  are  not 
directly  related  to  the  same  higher  level  goal. 

2.5  Evaluation  in  TRANSET  II  and  DODO 

Chapter  1  has  indicated  the  general  procedure  required  for 
defining  actions  and  predicting  their  consequences  in  DODOTRANS. 

These  procedures  were  very  similar  in  TRANSET  II  and  DODO.  Evaluation 
techniques  have  changed  significantly  from  TRANSET  II  to  DODOTRANS, 
however. 

2.5.1  TRANSET  II  Evaluation  Capabilities 

The  TRANSET  II  user  was  limited  to  a  number  of  "canned"  routines 
which  computed  quantities  such  as  consumer  surplus,  accessibility, 
gross  revenue,  and  total  user  cost.  The  only  flexibility  provided 
for  the  analyst  was  the  specification  of  a  partial  utility  in  terms 
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of  a  dollar  value  assigned  to  cime  and  an  estimate  of  waiting  time  as 
a  function  of  the  frequency  of  service.  The  only  goal  variables  the 
TRANSET  II  user  could  evaluate  were  those  provided  by  these  routines, 
namely:  consumer  surplus,  gross  revenues,  operating  balances,  and 
accessibilities. 

2.5.2  DODO  Evaluation  Capabilities 

The  DODO  user  was  able  to  proceed  further  in  the  evaluation 
process.  He  could  define  a  series  of  goal  variables ,  i.e.  ,  variables 
whose  values  provide  an  indication  of  how  well  a  particular  action 
achieves  predetermined  goals,  as  algebraic  combinations  of  variables 
from  the  sec  of  basic  consequences  generated  by  the  predictive  models. 

g 

A  set  of  goal  variable  definitions  was  called  a  goal  fabric.  The 
generalized  form  of  goal  fabric  definition  in  DODO  is  the  following: 

DEFINE  GOAL  FABRIC  'gfname' 

’goal^’  ■  [Operator]  [Operand  1]  [Operand  2] 

'goalj'  *=  [Operator]  [Operand  1]  [Operand  2] 

STOP  DEFINITION  OF  GOAL  FABRIC 


where  'gfname'  is  an  arbitrary  name  assigned  by  the  analyst  to  the 
goal  fabric, 

1  goal^' ,  '  goalj'  i  ...  a.-e  arbitrary  names  assigned  by  the  analyst  to 

g 

Hall,  Frederick,  and  M.  L.  Manheim,  Abstract  Representation  of 
Goal  Structures . 


-34- 


the  goal  variables, 

the  available  operators  are 


MINIMUM 

MAXIMUM 

TOTAL 

AVERAGE 

PRODUCT 


and  the  available  operands  are 


TRAVEL  TIME 
FARE 

FREQUENCY  OF  SERVICE 
TRIPS 


During  the  evaluation  process,  all  of  the  operands  must  be 
further  defined  by  specifying  an  origin  district,  destination  district 
and  mode  of  travel.  This  type  of  data  is  called  interdls trict  data. 

The  MINIMUM,  MAXIMUM  and  TOTAL  operators  require  a  single 
operand,  while  AVERAGE  and  PRODUCT  require  two  operands.  Examples 
of  goal  variable  definitions  in  DODO  are 

'TOTTRIP'  -  TOTAL  TRIPS 
1  MINTIME '  -  MINIMUM  TRAVEL  TIME 


' REVENUE' 


PRODUCT  OF  FARES  AND  TRIPS 
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The  DODO  user  can  evaluate  a  goal  fabric  for  a  given  set  of 
consequences  by  specifying  the  goal  variables  to  be  evaluated  a*  ’ 
their  respective  ranges  of  evaluation.  For  interdistrict  data,  the 
range  of  evaluation  is  specified  by  indicating  which  origin  districts, 
destination  districts,  and  modes  are  in  the  range.  An  example  of 
evaluation  in  DODO  is  shown  below: 

EVALUATE  GOAL  FABRIC  'VTOL',  CONSEQUENCES  *C1' 

'TOTTRIP'  FOR  ORIGIN  'BOSTON'  DEST  'NY'  MODES  ALL 
'MINTIME'  FOR  ORIGINS  ALL  DEST  ALL  MODE  'AIR' 

'REVENUE'  FOR  ORIGINS  ALL  DEST  ALL  MODES  EACH 
STOP  EVALUATION 


This  command  sequence  in  DODO  evaluates  goal  fabric  VTOL, 
previously  defined  by  the  analyst,  for  consequence  set  Cl,  which  was 
previously  predicted  by  the  analyst  using  other  DODO  commands.  Each 
of  the  goal  variables  specified  must  be  part  of  goal  fabric  VTOL. 
Evaluation  of  TOTTRIP  results  in  the  total  number  of  trips  by  all 
modes  between  Boston  and  New  York.  Evaluation  of  MINTIME  determines 
the  minimum  travel  time  over  all  routes  for  the  air  mode.  Goal  variable 
REVENUE  is  actually  evaluated  several  times.  Each  evaluation  computes 
the  gross  revenue  (defined  as  the  product  of  fares  and  trips)  over  all 
routes  for  a  single  mode.  The  number  of  evaluations  required  is 
determined  by  the  number  of  modes  in  the  system. 
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Thus  the  DODO  user  has  a  more  general  evaluation  capability  at  his 
disposal  than  the  TRANSET  II  user  did.  He  can  search  out  minimum, 
maximum,  and  average  values  of  certain  impacts  over  a  variety  of 
ranges,  ez  in  the  case  of  goal  variable  MINTIME  above.  He  can  also 
compute  totals  of  impacts  over  various  ranges,  as  in  the  case  of  goal 
variable  TOTTRIP.  Finally,  he  can  combine  certain  impacts,  such  as 
fares  and  trips  in  goal  variable  REVENUE,  into  a  single  goal  variable 
which  can  be  evaluated  for  different  ranges. 

2.5.3  Limitations  of  DODO  Evaluation  Procedures 

DODO  includes  the  beginning  of  a  general  computer-based  evaluation 
capability  for  transport  systems  analysis.  However,  experiments  con¬ 
ducted  with  the  DODO  evaluation  commands  revealed  several  limitations: 

1.  The  results  of  the  evaluation  of  a  goal  fabric  were  not  stored 
in  the  DODO  Information  files.  If  several  comparisons  were 
performed  upon  the  same  evaluation  results,  the  evaluations 
had  to  be  performed  again  for  each  comparison. 

2.  The  operators  provided  for  goal  variable  definitions  were 
inadequate.  Specifically,  a  division  operator  and  a  sum 
operator  which  accepts  more  than  two  operands  are  useful 
capabilities  which  were  not  available  in  DODO.  The  division 
operator  would  be  useful  to  compute  ratios  of  impacts  to 
determine  load  factors  on  vehicles,  the  percent  of  capacity 
being  used  on  line  haul  links,  etc.  The  sum  operator  is 
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neceasary  if  a  linear  scoring  function  is  to  be  included  aa 
an  evaluation  technique. 

3.  All  operands  were  implicitly  assigned  equal  weights  during 
goal  variable  evaluation.  A  utility  function  which  assigns 
different  weights  to  each  operand  in  a  goal  variable  would 
allow  an  analyst  to  Incorporate  a  statement  of  preferences 
into  the  evaluation  process.  The  most  basic  form  of  utililiey 
function  (and  the  easiest  to  implement)  would  be  a  linear 
scoring  function  consisting  of  a  vector  of  constant  weights. 
The  form  of  evaluation  of  a  goal  variable  using  the  sum 
operator  would  become: 


G  -  Z  W  X 

i  1  1 

where  G  is  the  computed  value,  and  hT  is  the  weight  assigned 
til 

to  the  1  operand  X^.  With  such  a  utility  function,  sensi¬ 
tivity  analysis  upon  the  assumed  goals  could  be  accomplished 
by  varying  the  weights. 

4.  Constant  data  could  not  be  specified  as  an  operand  in  the 
definition  of  a  goal  variable.  This  capability  would  allow 
a  constant  term  to  be  added  to  a  linear  scoring  function.  It 
would  also  allow  ratios  to  be  formeti  In  which  a  particular 
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Impact  was  compared  to  a  standard  value  specified  by  .he 
analyst. 

5.  Only  lnterdlstrlct  data  (as  defined  above)  could  be  specified 
as  operands  In  goal  variable  definitions.  The  analyst  should 
be  able  to  address  many  other  types  of  data  generated  by  the 
predictive  models  or  specified  during  the  definition  of 
actions.  Examples  of  new  data  classes  which  could  be  added 
are: 

Link  data  -  link  volumes,  link  speeds 

Mode  data  -  mode  subsidy,  mode  tax  rate 

District  data  -  district  population,  district  accessibility 
The  three  new  data  classes  listed  above  contain  many  data 
items  which  should  be  made  available  to  the  analyst  in 
evaluation  procedures. 

6.  The  analyst  could  not  rank  actions  based  upon  cheir  relative 
goal  performance.  A  capability  for  ranking  a  goal  variable 
over  a  set  of  actions,  consequences,  prediction  parameters  or 
utilities  would  facilitate  the  choice  of  the  best  action. 

This  capability  would  permit  parametric  analyses  to  be 
performed  which  would  indicate  how  sensitive  the  ranking  of 
actions  was  with  respect  to  uncertainty  in  the  estimation  of 
the  parameters  for  the  predictive  models.  The  sensitivity  of 
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the  rankings  to  the  preferences  indicated  by  the  utilities 
could  also  be  explored  with  this  capability. 


fS 


Each  of  the  limitations  noted  above  has  been  remedied  by  this 
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research  and  Incorporated  into  DO DOT RAN S.  The  details  of  the  new 
capabilities  are  outlined  in  Chapter  3. 


3.  EVALUATION AND  COMPARISON  CAPABILITIES  IN  DOPOTKANS 


3. 1  Introduction 

The  new  capabilities  for  goal  fabric  definition,  evaluation,  and 
comparison  are  presented  In  this  chapter.  The  details  of  the  command 
language  are  found  In  the  DODOTRANS  Users'  Manual*. 

3.2  Definition  of  Evaluation  Terminology 

It  is  necessary  at  this  point  to  define  a  number  of  te.ms  which  will 
be  used  throughout  this  chapter.  Some  of  the  terms  have  been  defined 
previously,  but  they  will  be  restated  here.  The  reader  will  be  familiar 
with  them  as  they  appear  in  subsequent  sections  of  this  report. 

Goal  Variable  -  A  goal  variable  is  a  combination  of  impacts  or 
consequences  chosen  because  i us  value  reflects  the  ability  of  an 
action  to  achieve  a  particular  goal  or  goals.  The  general 
structure  of  the  definition  of  a  goal  variable  Is  an  operator 
followed  by  one  or  more  operands. 

Goal  Fabric  -  A  goal  fabric  is  a  series  of  goal  variable  definitions. 
Operator  -  An  operator  in  a  goal  variable  definition  specifies  the 
operation  to  be  performed  upon  the  operands  in  order  to  compute  a 
value  for  the  goal  variable. 

Operand  -  An  operand  in  a  goal  variable  definition  may  be  either 
a  basic  consequence  variable  generated  by  the  predictive  models 
or  an  immediate  datum  (a  constant). 


Ruitar,  Earl  R.  ICES  DODOTRANS  Engineering  Users'  Manual,  R69-42 
Department  of  Civil  Engineering,  M.I.T.,  Cambridge,  Massachusetts, 
July,  1969- 


Data  Class  -  The  data  class  of  a  goal  variable  is  determined  by 


the  type  of  identifiers  required  to  completely  identify  a  member 
of  the  claas.  For  example,  the  interdistrict  d»*-a  class  is 
characterized  by  the  fact  that  complete  identification  requires 
specification  of  the  origin  district,  destination  district,  and 
mode  of  travel.  Other  data  classes  which  have  been  made  available 
for  evaluation  by  this  research  are  the  link,  mode,  and  district 
data  classes.  Link  data  is  identified  by  stating  the  numbers  of 
the  origin  and  destination  nodes.  Mode  data  is  identified  by 
specifying  the  name  of  the  mode.  Similarly,  district  data  is 
identified  by  specifying  the  name  of  the  district.  All  operands 
in  a  goal  variable  definition  mjst  be  from  the  same  data  class  so 
that  they  can  be  evaluated  over  a  common  range  of  evaluation. 

Range  of  Evaluation  -  The  range  of  evaluation  or  range  specifica¬ 
tion  refers  to  the  information  which  must  be  provided  during  the 
evaluation  of  a  goal  variable  to  indicate  which  specific  values 
of  the  operands  are  to  be  included  in  the  computation.  The  foimat 
of  the  range  specification  is  different  for  each  data  class.  The 
range  of  evaluation  of  an  interdistrict  goal  variable  includes  a 
set  of  routes.  The  range  for  a  link  goal  variable  includes  a  set 
of  links.  Similarly,  ranges  of  evaluation  for  district  and  mode 
goal  variables  are  comprised  of  sets  of  districts  and  modes, 
respectively.  Examples  of  ranges  of  evaluation  for  each  data 
class  are  given  below. 
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Interdistrict  data 


FROM  ORIGIN  ’BOSTON'  TO  DEST  'NY'  BY  MODES  ALL 
FROM  ORIGINS  ALL  TO  DEST  ALL  BY  MODE  'AIR' 

Link  data 


FROM  NODE  2301  TO  NODES  ALL 
FROM  NODES  ALL  TO  NODE  3003 

District  data 


FOR  DISTRICT  ’HARTFORD' 
FOR  ALL  DISTRICTS 


Mode  data 

FOR  MODE  'RAIL' 
FOR  ALL  MODES 


Utility  Function  -  The  purpose  o t  a  utility  function  is  to  include 
a  statement  of  preferences  in  the  evaluation  process.  A  utility 
function  in  this  chapter  refers  to  a  vector  of  constants  used  to 
weight  the  operands  in  a  goal  variable  definition  during  computa¬ 
tion.  This  form  of  utility  is  a  special  case  of  the  general 
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utility  function  in  which  the  utility  assigned  to  each  operand 
of  the  goal  variable  is  constant  for  all  values  of  the  operand. 

Now  that  we  have  defined  several  terms  used  in  the  description  of 
the  new  capabilities  implemented  as  part  of  this  research,  let  us 
proceed  to  examine  those  capabilities. 

3. 3  Goal  Fabric  Definitior. 

The  definition  of  goal  variables  has  been  expanded  to  include 
link,  mode,  and  district  data.  A  complete  list  of  the  operands 
provided  for  each  of  these  new  data  classes  appears  in  Appendix  1. 

The  introduction  of  three  new  data  classes  requires  that  the  data 
class  rauat  be  specified  in  the  goal  variable  definition.  Examples  of 
goal  variable  definitions  in  DODOTRANS  are  shown  below: 

'AVE-D-AC'  -  AVERAGE  DISTRICT  ACCESSIBILITY,  UNWEIGHTED 
' BTLENECK'  -  MINIMUM  LINK  SPEED 
'MAX- SUB'  -  MAXIMUM  MODE  SUBSIDY 

Goal  variable  AVE-D-AC  is  evaluated  by  summing  up  the  accessibility 
for  all  districts  in  the  range  of  evaluation  and  dividing  by  the  number 
of  districts.  BTLENECK  is  evaluated  by  searching  the  entire  range  of 
evaluation  for  the  link  with  the  minimum  speed  for  vehicles  traveling 
over  the  link.  When  this  goal  variable  is  displayed  it  is  necessary  to 
print  both  its  value  and  the  description  of  the  link  at  which  the 
value  occurred.  MAX-SUB  is  evaluated  by  searching  the  range  of 
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of  evaluation  for  the  mode  with  the  maximum  government  subsidy.  Again 
the  value  of  this  goal  variable  must  be  accompanied  by  the  mode  for 
which  the  value  was  found.  In  each  of  the  three  goal  variables  listed 
above,  the  computation  of  the  result  includes  multiplication  by  a 
utility  vector  consisting  of  a  single  constant.  The  obvious  choice 
for  the  utility  in  each  case  is  1.0. 

The  reason  for  distinguishing  between  data  classes  in  goal  vari¬ 
able  definitions  is  that  the  range  specification  used  during  evaluation 
varies  with  the  data  class.  Appendix  I  lists  the  form  of  range 
specification  for  each  data  class. 

Two  new  operators  have  been  provided  for  goal  variable  definitions. 
The  QUOTIENT  operator  requires  two  operands.  It  is  used  in  the  same 
manner  as  the  PRODUCT  operator.  The  SUM  operator  replaces  the  TOTAL 
operator.  It  may  be  used  with  any  number  of  operands,  provided  that 
they  are  all  of  the  same  data  class.  The  SUM  operator  is  used  as 
follows: 

'USERCOST'  -  SUM  OF  INTERDISTRICT  DATA, 

5.0 

FARE 

FREQUENCY 
TRAVEL  TIME 
END  LIST  OF  OPERANDS 
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Goal  variable  USERCOST  attempts  to  measure  the  total  cost  of  a 
trip  to  a  user  in  terms  of  the  fare,  frequency  of  service,  and  travel 
time  of  the  trip  in  a  linear  scoring  function.  USERCOST  is  evaluated 
by  performing  the  following  computation: 


USERCOST 


and 


E  E  £  KUj‘5.0)  +  CVF“V>  *  «3*FM;V>  *  ("**TTllk> 
1  J  R 


where 


i 

J  -  J 


ith  origin  district, 
th 


destination  district. 


k  *  k*"^  mode. 


U_. ,.U. 
1  4 


utilities, 

5.0  ■  constant  operand, 


FARE^^  “  fare  from  origin  i  to  destination  j  by  mode  k, 
FREQ^jj.  m  frequency  of  service  from  origin  i  to  destination  j 
by  mode  k, 

travel  time  from  origin  to  destination  J  by  mode  k 


TT 


ijk 


The  values  of  i,  j,  and  k  used  in  the  evaluation  of  USERCOST  are 
determined  by  the  origins,  destinations  and  modes  in  the  range  specifi¬ 
cation. 


3. 4  Utility  Function  Definition 

A  utility  function  consisting  of  a  linear  scoring  function  has 
been  added  to  DODOTRANS.  The  utility  is  defined  with  n  values  or 
weights.  Its  purpose  is  to  weight  the  operands  during  the  evaluation 
cf  a  goal  variable  with  n  operands.  Examples  of  utility  function 


definitions  follow: 
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UTILITY  'I-!',  1  VALUE,  1.0 


UTILITY 

'USER-1' , 

4 

VALUES,  1.0, 

1.0,  -1.0, 

0.04 

UTILITY 

'USER-2' , 

4 

VALUES,  1.0, 

1.0,  -1.0, 

0.08 

UTILITY 

'USER- 3'  , 

4 

VALUES,  1.0, 

1.0,  -1.0, 

0.16 

If  utility  USER-1  were  used  to  evaluate  goal  variable  USERCOST, 
the  resulting  confutation  would  be  of  the  form 


USERCCST  •  E  IZ  f(l. 0*5.0)  +  (1.0*FARE  )  -  (1.0*PR£Q  ) +  (0.04*TT 

i  j  V. 

Note  that  negative  weights  can  be  assigned  to  utilities.  This 
capability  is  significant  because  it  allows  the  analyst  to  model  any 
first  degree  polyr..  i  'll  by  constructing  an  appropriate  utility  function. 


3. 5  Goal  Fabric  Evaluation 

There  are  two  basic  changes  in  rhe  goal  fabric  evaluation 
procedure  as  implemented  in  D0D0TRANS.  The  first  change  is  that 
utilities  must  be  specified  prior  to  the  evaluation  of  a  goal  variable. 
Once  a  utility  function  hAs  oeen  specified  during  an  evaluation 
procedure,  it  is  used  in  subsequent  evaluations  until  a  new  utility 
function  la  named.  If  the  number  of  operands  in  the  goal  variable 
being  evaluated  does  not  equal  the  number  of  weights  in  the  current 
utility  function,  an  error  message  Is  printed,  the  goal  variable  is 
ignored,  and  evaluation  proceeds  with  the  next  goal  variable. 

The  second  cnange  in  the  evaluation  procedure  is  that  the  reR’ilts 
are  not  orinted  immediately  after  evaluation  takes  place.  This  was 


-47- 


done  because  the  analyst  does  not  always  want  an  immediate  listing  of 
all  of  the  results  of  an  evaluation.  The  volumes  of  output  would  be 
particularly  undesirable  in  a  time-sharing  environment  where  output 
is  generally  displayed  at  a  typewriter  console  with  a  very  slow 
printing  speed.  A  WRITE  EVALUATION  RESULTS  command  has  been  provided 
to  print  out  any  portion  of  the  evaluation  file.  See  Figure  3.1  for  an 
example  of  the  output  of  evaluation  results.  All  evaluation  results 
are  stored  in  the  DODOTRANS  information  files.  An  example  of  goal 
fabric  evaluation  follows: 

EVALUATE  GOAL  FABRIC  ’VTOL' ,  CONSEQUENCES  'C2' 

UTILITY  '1-i' 

'MAX-SUB'  FOR  ALL  MODES 

' BTLENECK'  FOR  LINKS  ALL 
UTILITY  'USER-1' 

'USERCOST'  FOR  ORIGIN  'NY'  DF.ST  'BOSTON'  MODES  ALL 
UTILITY  'USER-2' 

'USERCOST'  FOR  ORIGIN  'NY'  DEST  'BOSTON'  MODES  ALL 
UTILITY  'USER-3' 

'USERCOST'  FOR  ORIGIN  'NY'  DEST  'BOSTON'  MODES  ALL 
STOP  EVALUATION 


The  evaluation  proceeds,  in  the  following  manner: 

1.  First  the  general  tVALUATF  command  states  that  ail 

subsequent  goal  variables  are  to  be  found  in  goal  fabric 
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VTOL,  and  that  the  values  of  all  operands  are  to  be  retrieved 
from  consequence  set  C2. 

2.  Utility  1-1  is  specified  prior  to  the  evaluation  of  goal 
variables  MAX-SUB  and  BTLENECK,  each  of  which  has  but  one 
operand  in  its  definition. 

3.  Next  goal  variable  MAX-SUB  is  evaluated  for  all  modes.  The 
maximum  government  subsidy  for  all  inodes  defined  in  consequence 
set  C2  is  found  and  stored  in  the  DODOTRANS  evaluation  files. 
The  name  of  the  mode  is  also  stored. 

4.  Coal  variable  BTLENECK  is  evaluated  next.  The  link  with  the 
minimum  speed  is  found  and  the  value  (speed)  la  stored,  along 
with  the  description  of  the  link  for  which  the  value  was 
found. 

5.  Utility  USER-1  is  specified  prior  to  the  evaluation  of  goal 

variable  USERCOST.  Since  fares  in  DODOTRANS  are  expressed  In 
dollars  and  travel  times  are  expressed  in  minutes,  r'-e 
utility  values  of  0,04  applied  to  travel  time  an**  1. .  i.ed 

to  fare  results  in  a  valuation  of  time  of  .04  dollars  per 
minute.  This  corresponds  to  $2. 40/hour. 

6.  Coal  variable  USERCOST  is  evaluated  with  utility  'USER-1'  for 
each  mode  between  New  York  and  Boston. 

7.  Utility  USER-2  is  now  specified.  This  utility  values  time  at 
$4. jO/hour. 

8.  Goal  variable  USERCOST  is  evaluated  over  the  same  range  as 
before,  but  with  the  new  utility  USER-2. 
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9.  Utility  USER-3  is  specified,  assigning  a  value  to  time  of 
$9. 60/hour. 

10.  Finally,  goal  variable  USERCOST  is  evaluated  over  the  same 
range  with  utility  USER-3. 

11.  The  STOP  command  terminates  the  evaluation  process. 

Note  that  a  parametric  analysis  of  goal  variable  USERCOST  has  been 
performed  with  respect  to  the  value  of  a  traveler's  time  for  conse¬ 
quence  set  C2.  If  this  evaluation  were  repeated  for  all  consequences 
predicted  for  all  alternative  actions  in  an  analysis,  then  the  sensi¬ 
tivity  of  the  ranking  of  the  actions  with  respect  to  the  velue  of  time 
could  be  explored  by  examining  goal  variable  USERCOST  over  all 
consequences. 

3.6  Goal  Fabric  Comparison 

The  comparison  of  goal  fabrics  is  a  capability  which  was  present 
in  DODO  in  a  very  limited  form.  It  has  been  greatly  expanded  in 
DODOTRANS. 

3.6.1  Base  Specifications 

After  the  initial  COMPARE  command  has  been  given  to  indicate  which 
goal  fabric  is  to  be  examined,  the  analyst  must  declare  the  base 
specifications.  Base  specifications  must  be  declared  so  that  compu¬ 
tation  of  deviations  from  a  base  value  chosen  by  the  analyst  can  be 
performed.  The  ranking  of  actions  does  not  depend  upon  the  choice  of 
base  specifications.  Base  speci  ications  include  an  action,  parameter, 
consequence,  and  utility.  If  a  base  consequence  is  specified,  the 
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cr rrespondlng  action  and  parameter  are  retrieved  from  the  DODOTRANS 
information  files.  The  goal  variable  being  compared  must  have  been 
evaluated  for  the  base  specifications  or  the  comparison  will  be 
terminated. 

3.6.2  Set  Specification 

The  next  step  in  the  comparison  procedure  is  to  specify  a  set 
over  which  the  comparison  will  take  place.  A  set  is  merely  a  list  of 
names  which  can  be  referred  to  by  a  single  name.  The  set  may  be  either 
a  set  of  actions,  parameters,  consequences,  or  utilities.  Whichever 
sec  type  is  chosen,  the  corresponding  base  element  will  be  varied  by 
replacing  it  with  members  of  the  set  as  the  comparison  proceeds.  All 
other  base  specifications  remain  constant. 

3.6.3  Ranking  Specification 

The  analyst  has  the  option  of  ranking  goal  variable  valuations  in 
either  descending  or  ascending  order.  If  no  specification  is  given, 
descending  order  is  assumed.  However,  once  a  ranking  subcommand  has 
been  given  the  ranking  order  is  used  until  another  ranking  subcommand 
or  a  new  COMPARE  command  is  processed  by  the  system. 

3.6.4  Goal  Variable  Specification 

After  the  base  specific »'  ns  and  a  set  have  been  specified,  the 
goal  variable  name  and  range  of  evaluation  is  specified.  The  form  of 
specification  is  identical  to  the  form  used  In  evaluation. 

Comparison  proceeds  as  the  evaluation  file  is  searched  for  values 
of  the  goal  variable  which  were  obtained  from  the  actions,  parameters, 
consequences,  utilities  and  range  of  evaluation  specified  in  the 


-52- 


coenand.  When  all  values  have  been  retrieved,  the  tabular  output  is 
prepared  which  Includes  the  values  retrieved,  the  ranking  of  the 
values,  the  difference  of  each  value  from  the  base  (both  absolute  and 
X  difference),  and  the  difference  between  each  value  md  the  maximum 
and  minimum  values.  The  example  problem  described  In  Chapter  4 
contains  many  examples  of  output  from  the  COMPARE  GOAL  FABRIC  command. 


4. 


EXAMPLE  OF  EVALUATION  IN  DO DOT RAN S 


4. 1  Introduction 

This  chapter  describes  the  evaluation  and  comparison  of  impacts 
for  the  three  alternative  VTOL  strategies  outlined  in  Chapter  1.  The 
definition  of  actions  and  prediction  of  their  consequences  are  not 
described  in  detail  here.  They  have  been  included  in  Appendix  II, 
however.  The  Intent  of  this  chapter  is  to  focus  upon  the  use  of  the 
new  capabilities  for  the  evaluation  and  comparison  of  goal  fabrics 
which  were  implemented  as  part  of  this  research.  The  sequence  of  the 
discussion  parallels  the  sequence  of  the  analyses  which  were  performed 
to  evaluate  and  compare  the  three  VTOL  strategies  described  in  Chapter 
1.  The  reader  can  follow  the  analysis  in  the  computer  listings 
included  at  the  end  of  this  chapter.  The  listings  have  been  annotated 
to  include  the  number  of  the  subsection  of  this  chapter  which  describes 
each  portion  of  the  analysis. 

4.2  Construction  jf  a  Goal  Fabric 

Evaluation  of  the  VTOL  strategies  uses  the  goal  fabric  technique 
described  earlier.  The  construction  of  a  goal  fabric  involves  the 
identification  of  combinations  of  impacts  which  measure  the  goal 
performance  of  an  action.  Goal  variables  in  the  goal  fabric  should 
be  defined  in  terms  of  impacts  which  1)  affect  the  relevant  actors  in 
the  system,  and  2)  are  likely  to  vary  significantly  with  the 
alternative  strategies  being  analyzed.  The  impacts  chosen  for  goal 
variable  definitions  should  be  outputs  of  the  predictive  models  in 
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DODOTRANS  whenever  possible,  as  opposed  to  Impacts  specified  as  inputs 
by  the  analyst.  For  example,  subsidies  ty  e ach  mode  are  undoubtedly 
a  significant  impact  reflecting  upon  both  the  operators  of  each  mode 
and  the  federal  government.  However,  since  direct  subsidies  are  direct 
inputs  to  the  DODOTRANS  models,  a  more  interesting  goal  variable  would 
be  the  operating  balance  of  each  mode. 

The  first  step  in  construction  of  a  goal  fabric  is  to  identify 
the  relevent  actors.  For  this  example,  three  relevent  actors  will  be 
identified.  There  are  many  more  than  three  actors  in  most  transport 
systems  problems  (including  this  example),  but  the  three  chosen  here 
will  be  sufficient  to  demonstrate  the  methodology  of  evaluation  using 
DODOTRANS.  The  three  actors  identified  in  this  analysis  are: 

1.  Users  of  the  transportation  system 

2.  Operators  of  each  mode  (except  auto) 

3.  Federal  government 

The  impacts  of  the  system  on  users  is  reflected  in  performance 
measures  such  as  travel  times  and  frequency  of  service.  They  are  also 
affected  by  fares  and  taxes  applied  to  fares. 

Impacts  which  affect  the  operators  include  revenues,  operating 
costs,  government  subsidies  and  tax  rates  on  fares. 

The  federal  government  is  affected  by  government  subsidies  to 
operators  and  taxes  collected  on  fares. 

All  three  actors  are  affected  by  the  total  amount  of  travel 
throughout  the  system.  They  all  are  also  affected  by  the  accessibility 
of  each  district  to  travel  by  each  mode. 
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consequences  corresponding  to  the  three  VTOL  strategies  with  three 
actions  in  each  strategy. 

4. 7  Comparison  of  Goal  Fabric  VTOL-VAL 

Let  us  explore  the  valuations  of  goal  fabric  VTOL-VAL  for 
consequence  set  VTOL-SET.  After  giving  the  general  COMPARE  GOAL 
FABRIC  command,  we  specify  base  consequence  BIG3-1,  base  utility  1-1, 
and  consequence  set  VTOL-SET.  The  choice  cf  e  base  consequence  is  an 
arbitrary  one. 

First  we  compare  goal  variable  BTLENECK  over  consequence  set 
VTOL-SET.  The  values  will  be  ranked  in  descending  order  so  that  the 
alternative  with  the  highest  minimum  link  speed  will  be  ranked  first. 
Since  three  time  periods  are  represented  by  the  consequences  in  set 
VTOL-VAL,  we  might  expect  the  general  increase  in  the  demand  for 
travel  as  a  function  of  time  (due  to  positive  growth  in  the  population 
of  the  region)  to  cause  the  actions  in  1970  to  be  ranked  higher  than 
the  actions  in  1975  and  1980.  The  table  of  comparison  results  confirms 
this  assumption.  Examination  of  the  ranking  of  the  values  of  BTLENECK 
shows  that  the  top  three  values  correspond  to  1970,  the  next  three 
values  to  1975,  and  the  last  three  to  1980. 

The  ranking  is  not  the  most  useful  information  found  in  the 
comparison,  however.  Note  that  the  actual  values  of  BTLENECK  range 
from  a  high  of  2.03  to  a  low  of  1.46.  Since  these  values  represent 
speeds  in  miles  per  hour,  it  appears  that  a  portion  of  the  transporta¬ 
tion  system  is  heavily  congested  in  all  stages  of  each  strategy.  The 
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WRITE  EVALUATION  RESULTS  command  will  be  used  later  to  determine  the 
location  of  these  congestion  points. 

Goal  variable  CONGEST  is  examined  next  over  consequence  set 
VTOL-SET.  The  ranking  is  computed  in  ascending  order.  The  results 
of  this  comparison  also  reveal  that  the  ranking  of  actions  is  directly 
related  to  the  time  period  in  which  the  action  occurred.  The  values 
for  1975  are  approximately  82  higher  than  the  values  of  1970,  while 
the  values  for  1980  are  approximately  202  higher.  The  alternative 
actions  in  a  given  stage  are  generally  within  12  of  each  other  with 
respect  to  the  values  of  CONGEST.  A  notable  exception  is  stage  1  of 
strategy  UIG3.  The  omission  of  VIOL  service  for  the  Philadelphia  and 
Hartford  districts  has  an  adverse  effect  on  the  maximum  link  volume  for 
stage  1,  which  seems  to  disappear  in  later  stages  when  all  districts 
are  served  by  VTOL. 

A  comparison  of  the  average  district  accessibility  reveals  a 
general  improvement  in  this  goal  variable  over  time  for  each  strategy. 
Stage  1  of  strategy  BIG3  again  performs  poorly  because  of  its  limited 
VTOL  service. 

A  closer  examination  of  the  rankings  for  the  three  comparisons 
performed  thus  far  reveals  that  no  strategy  ranks  consistently  ahead 
of  the  others  for  all  three  stages.  In  fact,  the  ranking  for  goal 
variable  AVE-D-AC  indicates  that  strategy  CHAIN  is  preferred  in  stage 
1,  strategy  NY-AREA  is  preferred  in  1975,  and  strategy  BIG3  is 
preferred  in  IS  80. 
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Examination  of  Che  percent  differences  from  the  base  value  for 
each  of  the  three  comparisons  reveals  that  the  differences  between  the 
strategies  tend  to  become  smaller  In  later  stages. 

Finally  we  compare  the  gross  revenues  for  each  mode  over  conse¬ 
quence  set  VTOL-SET.  The  results  follow  the  pattern  of  previous 
comparisons.  Revenues  generally  increase  with  time.  The  initial 
stage  of  strategy  BIG3  generates  a  much  lover  revenue  for  VTOL  than 
the  other  two  strategies  in  the  same  stage.  The  rankings  for  the  air, 
road,  ana  rail  modes  are  very  similar  to  each  other.  However,  they 
differ  substantially  from  the  ranking  for  VTOL.  This  is  probably  true 
because  the  range  of  service,  i.e.  routes  served,  does  not  change  over 
time  for  modes  other  than  VTOL. 

4. 8  Closer  Examination  of  BTLENKCK  and  CONGEST 

The  WRITE  EVALUATION  RESULTS  command  is  used  next  to  determine  the 
location  of  the  low  speeds  and  high  volumes  which  were  pointed  out  by 
the  evaluation  of  goal  variables  BTLEHECK  and  CONGEST,  The  low  speeds 
located  with  the  BTLENECK  goal  variable  are  VTOL  and  rail  terminal 
links.  Their  values  do  not  necessarily  represent  congestion  in  the 
system  at  the  terminals  because  terminal  links  are  designed  only  to 
model  the  time  delay  caused  by  passage  through  a  terminal.  Their 
lengths  and  speeds  are  not  true  measures  of  the  physical  system.  Only 
their  travel  times  are  relevant. 

The  high  volumes  highlighted  by  the  evaluation  of  goal  variable 
CONGEST  occur  on  a  rail  access  link  in  the  New  York  City  area.  Access 
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link*  carry  travelers  between  the  terminal  and  their  point  of  origin  or 
ultimate  destination.  The  congestion  noted  in  this  css*  mav  be  indica¬ 
tive  of  congestion  in  the  real  system.  However,  the  possibility  exists 
that  the  congestion  is  caused  by  poor  modeling  f  the  rail  system  in 
the  New  York  area. 

4,9  Definition  of  New  Sets 

The  comparisons  performed  thus  far  have  indicated  that  the  valua¬ 
tions  of  goal  variables  are  related  to  tha  time  stage  la  which  the 
consequences  were  predicted.  It  makes  sens*,  therefore,  to  define 
three  new  sets  of  consequences.  Each  set  will  include  the  consequences 
corresponding  to  the  alternative  actions  in  each  stage  of  the  analysis. 
The  new  seta  are  named  STACE1,  STAGE2,  and  STACE3.  They  corraapond  to 
1970,  1975,  and  1980,  respectively . 

A. 10  Comparison  of  Coal  Variables  REVENUE  and  AVK-D-AC  by  Stage 

A  new  comparison  of  goal  variables  REVENUE  and  AVE-D-AC  is 
parformed  next  in  which  the  consequence  sets  STAGE1,  STACE2,  end 
STAGE 3  ere  uaed.  Comparison  over  those  secs  ellmlnacas  the  effect 
of  time  from  the  results. 

The  comparison  for  consequence  set  STAGE1  (1970)  reveale  that 
strategy  UIG3  generates  60%  leso  revenue  for  the  VTOL  mode  than  either 
of  the  other  two  strategics.  The  ccmparlson  for  the  other  three  modes 
Indicates  that  their  gross  revenues  are  rather  insensitive  to  the 
choice  of  a  VTOL  strategy.  The  largest  percent  difference  in  revenues 
for  the  other  modes  is  3.26%  for  Che  rail  mode.  The  best  VTOL  strategy 
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In  this  stage  in  terns  of  gross  VTOL  revenue  Is  GLAIN.  However  the 
NY-AREA  strategy  la  inferior  by  less  than  1%. 

Strategy  HIC3  Is  also  Inferior  in  terns  of  average  district 
accet slblllty  in  stage  1.  Strategies  CHAIN  »nd  NY -ARE A  are  better  by 
16.9%  and  14.1%,  respectively. 

The  results  of  comparisons  over  consequence  set  STAGE2  indicate 
that  strategy  BIC3  generates  10%  less  gross  VTOL  revenue  than  either 
of  the  other  two  alternative  strategies.  The  other  nudes  are  again 
insensitive  to  the  VTOL  alternatives.  T'ne  maximum  percent  difference 
in  gross  revenues  for  other  inodes  is  only  1.73%. 

The  comparison  of  average  district  accessibility  reveals  that 
strategy  U1C3  has  improved  ic  w  thin  5.25%  of  Che  best  strategy, 
NY-ARKA.  Strategy  CHAIN  is  only  0.28%  worse  than  strategy  NY-AREA. 

Comparison  of  revenues  for  consequence  set  STAGL3  reveals  that 
the  VTOL  mode  now  behaves  in  a  manner  very  simil*  to  that  of  the 
other  three  modes.  Strategy  NY-AREA  generates  gross  revenues  which 
are  1-1/2%  to  2-1/2%  greater  than  revenues  for  strategy  UIG3  for  each 
mode,  including  VTOL.  The  CHAIN  strategy  generates  gross  revenues 
which  are  about  1%  greater  chan  corresponding  revenues  for  strategy 
U1G3,  again  for  all  modes.  The  similarity  in  the  relative  performance 
of  alternative  strategies  for  all  modes  in  stage  3  must  reflect  the 
fact  that  i  complete  VTOL  service  hao  finally  been  established. 
Relative  fares  and  travel  times  over  different  VTOl  .es  vary  in  a 
manner  similar  to  the  fares  and  travel  times  for  other  modes,  though 


the  absolute  values  arc  not  the  same. 
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Average  accessibilities  in  stage  3  are  almost  Identical  for  all 
strategies.  The  best  strategy,  BIG3,  exceeds  the  worst  strategy, 
NY-AREA,  by  only  0.31%.  This  fact  does  not  indicate  that  the  accessi¬ 
bilities  of  individual  districts  are  necessarily  the  same  for  each 
strategy,  however. 

4.11  Further  Definition  of  Goal  Variables 

The  results  of  evaluation  and  comparison  of  the  goal  variables 
defined  thus  far  should  now  be  used  to  suggest  areas  for  further 
evaluation.  While  goal  variables  BTLENECK  and  CONGEST  revealed  the 
maximum  flows  or  congestion  points  in  Che  transportation  system, 
perhaps  a  measure  of  total  system  usage  would  be  more  indicative  of 
the  relative  performance  of  the  alternative  transportation  systems. 

In  particular,  we  can  measure  the  total  passenger-miles  and  total 
passenger-minutes  generated  by  each  strategy  in  each  stage  by  defining 
two  new  goal  variables  as  follows: 

'  T AS SMILE'  -  PRODUCT  OF  LINK  PASSENGER  VOLUME  AND  LENGTH 

' PASSMIN*  «  PRODUCT  OF  INTERDISTRICT  TRIPS  AND  TRAVEL  TIME 

Further  information  on  the  performance  of  each  alternative  can 
be  obtained  by  an  examination  of  the  average  fare  and  average  inter¬ 
district  travel  time,  in  each  case  weighted  by  the  number  of  trips 
over  each  route.  We  define  goal  variables  AVEFARE  and  AVETIME  for 


this  reason. 
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'AVEFARE'  -  AVERAGE  OF  INTERDISTRICT  FARE  WEIGHTED  BY  TRIPS 
1 AVETIME'  -  AVERAGE  OF  INTERDISTRICT  TRAVEL  TIME  WEIGHTED  BY  TRIPS 

The  gross  revenues  examined  earlier  revealed  that  users  were 
spending  more  money  on  VTOL  than  on  any  other  mode.  Those  figures  do 
not  represent  the  total  cost  of  f—ivel  to  the  user,  however,  because 
the  travel  times  of  the  different  modes  vary  substantially  over  a  given 
route.  A  goal  variable  could  be  defined  which  measures  more  closely 
the  total  cost  of  travel  to  the  user  by  including  the  travel  time  and 
frequency  of  service  as  cost  elements.  The  simplest  analytical  form 
is  a  linear  scoring  function  consisting  of  the  sum  of  fare,  frequency, 
and  travel  time,  each  weighted  by  an  appropriate  utility.  A  constant 
might  also  be  included  in  the  scoring  function  to  provide  a  non-zero 
cost  for  zero  values  of  the  variables  in  the  function.  Let  us  hypothe¬ 
size  a  linear  scoring  function  to  estimate  total  user  cost  of  the 
following  form: 

USERCOST  -  RAVEL  TIME)  +  (U2*FARE)  +(U3*K)  -  (INFREQUENCY ) 

where  U^,  are  assumed  utilities 

and  K.  is  a  frequency  at  which  the  cost  due  to  frequency  of  service 
is  assumed  to  be  zero.  Values  of  frequency  less  than  K 
result  in  a  positive  cost,  while  values  greater  than  K 
result  in  a  negative  cost. 

Ve  can  define  a  goal  variable  of  this  form  in  DODOTRANS  as  follows: 


’USERCOST’  •  SUM  OF  INTERDISTRICT  DATA 


K 

TRAVEL  TIME 
FARE 

ppEQUENCY 
END  LIST 


The  value  of  K  will  be  arbitrarily  set  to  10  for  subsequent 
evaluations  of  USERCOST. 

A. 12  Definition  of  New  Utilities  for  Goal  Variable  USERCOST 

Goal  Variable  USERCOST  cannot  be  evaluated  until  a  four-dimensional 
utility  has  been  defined.  Four  new  utilities  will  be  defined,  each  of 
which  assumes  a  different  value  for  travel  time.  Frequency  will  be 
valued  at  $. 01/unit,  where  the  units  are  in  departures  per  day.  Time 
will  be  assigned  values  of  $1.20,  $2.40,  $4.80,  and  $9.60  per  hour  by 
weighting  travel  times  in  minutes  to  fares  in  dollars  in  ratios  of  .02, 
.04,  ,03,  and  .16,  respectively.  The  new  utilities  are  defined  as 
follows; 


UTILITY 

'USER-1' , 

4 

VALUES , 

1.0, 

1.0, 

0.02,  -0.01 

UTILITY 

'USER- 2'  , 

4 

VALUES, 

1.0, 

1.0, 

0.04,  -0.01 

UTILITY 

'USER-3'  , 

4 

VALUES , 

1.0, 

1.0, 

0.08,  -0.01 

UTILITY 

'USER-4'  , 

4 

VALUES , 

1.0, 

1.0, 

0.16,  -0.01 
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4.13  Evaluation  of  New  Goal  Variables 

The  new  goal  variables  must  be  evaluated  for  each  of  the  VTOL 
strategies.  Goal  variable  I'SERCOST  will  be  evaluated  four  times  for 
each  set  of  consequences,  once  for  each  new  utility.  The  evaluation 
for  consequence  B1G3-1  Is  shown.  The  procedure  is  identical  for  all 
other  consequence  sets. 

Goal  variable  PASSMIN  la  evaluated  for  all  routes  and  modes. 

PASSMTLE  is  evaluated  for  all  links.  AVETIME,  AVEFARE,  and  USERCOST 
are  evaluated  once  for  each  mode  over  all  routes. 

4. 14  Comparison  of  New  Goal  Variables 

We  begin  the  comparison  by  examining  the  total  passenger-minutes 
for  all  VTOL  strategies  in  all  stages.  The  values  increase  with  time 
for  all  strategies,  with  strategy  B!G3  having  the  lowest  value  in  each 
stage.  The  alternatives  were  ranked  in  ascending  order  on  the  arbitrary 
assumption  that  lower  values  of  total  system  usage  were  preferred.  The 
ranking  of  a  measure  of  total  system  usage  may  vary  for  different 
actors.  Users  may  prefer  low  usage  while  operators  prefe  high  usage. 
The  values  in  a  given  stage  are  within  3 7.  of  each  other  for  all  stages. 
An  average  growth  in  passenger-minutes  of  approximately  35%  is  experi¬ 
enced  by  all  three  strategies  between  1970  and  1980. 

A  comparison  of  pasaenger-miles  over  consequence  set  VTOL-SET 
appears  to  he  quite  similar  to  the  comparison  of  passenger-minutes. 
Strategy  BIG3  again  has  the  lowest  value  in  each  stage.  The  performance 
of  strategy  BIG3  tor  goal  variables  PASSMILE  and  PASSMIN  can  be 


explained  by  its  relative  inability  to  generate  a  ? -rge  VTOL  dtanand  in 
the  earlier  stages*  Lower  demand  naturally  results  in  lower  system 
usage. 

Coal  variables  AVEFARE  and  AVETIME  are  compared  next  over  all 
otrategles  in  a  given  stage.  Since  AVEFARE  reflects  the  relative  travel 
over  different  routes  for  a  particular  mode,  it  is  not  surprising  to 
note  that  strategy  BIG3  has  a  42%  higher  average  VTOL  fere  than  the 
best  strategy,  CHAIN.  Elimination  of  VTOL  service  to  Philadelphia  and 
Hartford  reduces  the  number  of  short  trips  which  can  be  taken  by  VTOL. 
The  average  travel  time  by  VTOL  behaves  in  a  similar  fashion  for 
strategy  BIG3  in  stage  1.  The  average  time  is  20%  higher  for  BIG3  than 
for  the  best  strategy  (CHAIN).  In  stage  2  strategy  3IG3  improves  the 
VTOL  mode  so  that  it  is  within  6%  at  strategy  CRAIN.  In  stage  .3  the 
three  strategies  exhibit  average  travel  times  and  fares  that  are 
virtually  equal.  Average  times  and  faras  for  all  otkar  modes  reveal 
a  marked  ineensitivity  to  the  alternative  VTOL  strategist  in  all 
stages.  All  comparisons  except  one  reveal  differences  of  lesu  tnan  1% 
in  average  fares  and  travel  times  for  the  other  modes. 

4.15  Definition  of  a  Set  of  Utilities 

Next  we  define  a  set  which  includes  the  new  utilitie3  USER-1, 
USER-2,  USER-3,  and  USER-4  30  that  a  comparison  of  gosl  variable 
USERCOST  can  be  performed  over  a  range  of  utilities.  The  set  is  named 
UTILSETi.  The  comparison  over  this  set  corresponds  to  a  parametric 
analysis  of  the  assumed  value  of  travel  time. 
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4. 16  Comparison  of  Goal  Variable  USERCOST 

USERCOST  Is  compared  over  the  range  of  utilities  in  utility  set 
UTII.SET1  f . r  each  strategy  in  stage  3.  Values  are  ranked  in  ascending 
order.  The  values  of  USERCOST  for  a  given  mode  were  found  to  rank  in 
the  same  order  as  the  values  assigned  to  travel  time  in  the  utility 
functions.  This  result  is  totally  predictable  because  all  other 
elements  of  USERCOST  remain  constant.  A  more  interesting  result  is 
the  ranking  of  modes  for  a  given  value  of  travel  time.  For  each 
strategy  in  stage  3,  the  ranking  of  modes  according  to  USERCOST  eval¬ 
uated  with  utility  function  USEK-1  (with  travel  time  valued  at  $1.20/ 
hour)  is  the  following: 

1  -  Road 

2  -  VTOL 

3  -  Rail 

4  -  Air 

However,  the  ranking  of  USERCOST  evaluated  with  the  other  three  utility 
functions  is  noted  below: 

1  -  VTOL 

2  -  Air 

3  -  Rail 

4  -  Road 

Furthermore,  the  ranking  is  more  pronounced,  i.e.  the  intervals  between 
the  values  for  different  modes  become  greater,  as  the  value  assigned  to 
travel  time  increases.  The  implication  to  be  drawn  from  this  result  is 
that,  according  to  this  simple  midel  of  user  cost,  there  are  critical 

values  of  traveJ  time  between  ,;1 .  20/Tiour  and  $2 . 4D/hour.  The  total 


-68- 


cost  co  road  usera  throughout  the  system  equals  the  total  cost  for 
users  of  the  ocher  nodes  at  these  critical  values.  This  conclusion 
is  based  on  the  fact  that  the  road  node,  with  lower  fares  and  higher 
travel  tines,  is  ranked  first  in  terns  of  USERCOST  when  tine  is  valued 
at  $1.20  per  hour.  But  when  travel  time  is  assigned  a  value  of  $2.40 
per  hour,  the  road  node  is  ranked  last.  Additional  utilities  could  be 
defined  which  assigned  values  to  travel  tine  between  $1.20  per  hour 
and  $2.4C  per  hour.  Parametric  analysis  using  the  COMPARE  GOAL  FABRIC 
command  would  define  more  accurately  those  values  of  travel  time  at 
which  USERCOST  for  users  of  the  road  mode  equals  the  costs  to  users  of 
air,  VTOL,  and  rail  over  all  routes. 

4. 17  Conclusions 

We  have  seen  how  the  goal  fabric  definition,  evaluation,  and 
comparison  capabilities  in  DODOTRAK3  can  be  used  to  analyze  the  conse¬ 
quences  of  a  number  of  alternative  transportation  systems.  The  itera¬ 
tive  manner  in  which  the  analyst  car.  define  an  initial  statement  of 
goals,  evaluate  consequences  in  terms  of  those  goals,  compare  the 
evaluations,  form  new  goal  statements  based  upon  the  evaluations,  and 
repeat  the  process,  has  been  illustrated. 

Conclusions  relevant  to  the  problem  being  analyzed  as  well  as  to 
the  methodology  can  be  drawn  from  the  analysis  described  in  this 
chapter.  These  conclusions  are  summarized  below: 

1.  The  extremely  low  speeds  occurring  on  terminal  links  are  not 
necessarily  indicative  of  overall  congestion  ir.  the 
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transportatinn  system.  Terminal  links  were  designed  to  model 
a  time  delay  caused  by  movement  through  a  terr.inal  facility. 
Neither  their  lengths  nor  speeds  are  designed  to  measure  true 
properties  of  the  physical  system.  Only  their  travel  times 
attempt  to  measure  real  world  quantities. 

2.  The  high  volumes  on  the  rail  access  link  for  passengers 
disembarking  at  New  York  City  seem  to  indicate  heavy  congestion 
in  that  area  of  the  transportation  system  for  all  strategies 

in  all  stages.  However,  the  results  may  be  caused  by  poor 
modeling  of  the  rail  network. 

3.  Strategy  BIG3  generates  less  demand  for  VTOL  travel, 
especially  in  stage  1,  because  of  the  omission  of  service 
to  Philadelphia  and  Hartford  in  1970. 

4.  The  differences  in  revenues,  travel  times  and  average  fares 
are  most  noticeable  in  earlier  stages.  The  differences  are 
almost  indistinguishable  in  1980  when  VTOL  service  is  available 
on  all  routes. 

5.  The  conventional  air,  rail,  and  road  modes  are  almost  totally 
insensitive  to  the  alternative  VTOL  strategies.  The  values  of 
most  goal  variables  varied  less  than  12  for  the  three  alterna¬ 
tive  actions  in  a  given  stage  for  these  modes. 

6.  No  strategy  consistently  dominated  the  rankings  of  goal 
variables  in  any  of  the  comparisons.  However,  strategies 
CHAIN  and  NY-AREA  in  general  performed  better  than  strategy 


BIC3. 
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7.  All  goal  variablei,  rapraaanting  both  coata  and  benefit*, 
tend  to  lncraaaa  In  valua  with  time.  Thla  fact  reflacta  tha 
poaltlva  growth  In  population  which  occura  In  tha  ayatam 
oetwaan  1960  and  1980,  Tha  damand  for  transportation 
lncraaaae  as  the  number  of  people  in  tha  region  grows. 

8.  Parametric  analysis  of  tha  valua  of  travel  tlma  reveals  that 
there  axial  valuaa  of  tin*  between  $1.20  par  hour  and  $2.40 
per  hour  at  which  the  road  mode  generates  costs  to  usera  over 
all  routes  which  are  identical  to  coats  incurred  by  users  of 
the  other  modee.  Tha  road  mode  is  lass  costly  than  all  other 
Modes  whan  travel  time  la  valued  at  $1.20  per  hour. 

9.  Bince  VTOl  is  more  competitive  with  conventional  air  travel 
over  short  routaa  because  of  its  advantage  in  lower  travel 
tines  foi  portions  of  a  trip  other  than  the  line  haul  aagment, 
a  fourtli  VTOL  strategy  might  be  generated  and  evaluated  In 
which  the  longest  VTOl.  routes  wsre  Implemented  In  the  later 
stages.  No  districts  should  bs  sxcluded  from  VTOl  n*rvice  in 
any  stage,  however.  Figure  4.1  Illustrates  a  new  strategy 
which  might  be  considered  based  on  the  performance  of  the 
original  thrae  strategies. 

4,18  Choice  of  a  VTOl.  Stratsty 

The  evaluation  and  comparison  capabilities  In  UODOTRANB  do  not  mnke 
a  final  selection  of  a  hast  alternative  for  Implementation  In  the  real 
world.  The  dsclnlon-maker (e)  must  examine  the  results  of  the 
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evaluations  in  view  of  Che  preferences  of  each  of  Che  relevant  actors. 
They  oust  decide  how  to  wnlgh  Che  preferences  of  Che  different  actors 
before  establishing  a  final  preference  ordering  over  all  alternative 
actions.  Finally,  Che  decision-maker (s)  must  examine  Che  preferred 
action  and  decide  whether  to  implement  it  or  to  request  that  new 
alternatives  be  generated  and  evaluated.  The  final  derision  must 
always  rest  with  the  decision-maker,  not  the  computer  system. 
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5. 


SYSTEMS  r.SIGN  CONSIDERATIONS 


5. 1  Introduction 

This  chapter  Includes  a  discussion  of  the  design  of  the  system 
for  implementing  the  new  capabilities  illustrated  as  part  of  this 
research.  Diagrams  of  the  file  structures  referred  to  in  this  dis¬ 
cussion  appear  at  the  end  of  the  chapter. 

5.2  Goal  Variable  Definition 

Coded  definitions  of  goal  variables  are  stored  in  the  ICOM  array. 
The  ICOM  array  has  three  subscripts.  The  first  subscript  I  corresponds 
to  the  Ith  goal  fabric.  The  second  subscript  J  corresponds  to  the  Jth 
goal  variable  within  the  Ith  goal  fabric.  The  dictionaries  of  goal 
fabric  and  goal  variable  names  are  maintained  in  the  FILD1C  and  FILDAT 
arrays.  The  third  subscript  in  ICOM  refers  to  the  goal  variable 
definition  codes  themselves. 

The  codes  used  for  operators,  data  classes,  and  operand  data 
types  are  shown  in  Table  5.1. 

The  codes  assigned  to  the  operands  in  each  data  class  are  shown 
in  Tab le  5.2. 

5.3  Utility  Function  Definition 

Definitions  of  utility  functions  are  maintained  in  the  UTIL  array. 
Since  utility  functions  currently  are  limited  to  linear  scoring 
functions,  their  definition  consists  of  a  column  of  N  values,  preceded 
by  a  counter  indicating  Che  number  of  \alues  N. 
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Table  5.1:  GOAL  VARIABLE  DEFINITION  CODES 


Operators 

Minimum  1 

Maximum  2 

Average  3 

Product  4 

Quotient  5 

Sum  6 

Data  Classes 

Link  1 

Mode  2 

District  3 

Interdistrict  U 

Operand  Data  Type  Code 

Basic  Variable  1 

Goal  Vat  1  able  2 

Immediate  Data  3 
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Table  5.2:  OPERAND  CODES 


Link  Data  Operand  Codes 

Vol/Delay  Number  1 

Number  of  Lanes  2 

Length  3 

Passenger  Volume  4 

Speed  5 

Travel  Time  6 

Mode  Type  7 

Link  Type  tt 

Capacity  9 

Origin  Node  X  Coordinate  10 

Origin  Nou*.  \  Coordinate  11 

Deotination  Node  X  Coordinate  12 

Deatinatlon  Node  Y  Coordinate  13 

Mode  Data  Operand  Codes 

Subsidy  i 

Fixed  Cost  2 

Va_<<tble  Coat  Rate  3 

Tux  Rate  4 

Arci<‘:sit>illty  3 

District  Data  Operand  Codes 

Population  i 

I’er  Capita  Income  2 


-119- 

Table  5.2  (Continued) 


Holding  Capacity  3 

X  Coordinate  A 

Y  Coordinate  5 

Accessibility  6 

Interdlatrlct  Data  Operand  Codes 

Trips  1 

Travel  Tirce  2 

Fare  .1 

Frequency  of  Service  A 

Speed  5 

distance  b 
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5.4  Storage  of  Evaluation  Results 

The  major  task  In  system  design  was  the  establishment  of  a  file  to 
store  the  results  of  a  series  of  evaluations.  The  manipulations  and 
computations  performed  by  the  COMPARE  GOAL  FABRIC  command  and  the 
WRITE  EVALUATION  RESULTS  command  require  an  evaluation  file  structure 
which  can  be  cross-referenced  efficiently.  The  evaluation  file  has 
to  maintain  not  only  the  reaulta  of  evaluations,  but  also  sufficient 
information  Co  reconstruct  thi  manner  in  which  the  results  were 
generated.  Complete  Identification  of  a  set  of  results  requires 
specification  of  the  following  diaenalons: 

1  -  Goal  Fabric  Name 

2  -  Coal  Variable  Nana 

3  -  Consequence  Set  Name 

4  -  Utility  Function  Nam* 

5  -  Range  Specification 

Since  five  dimensions  are  required  tc  aperify  a  particular  evalua¬ 
tion  result,  one  possible  file  structure  would  consist  of  a  alx- 
dlmsnslonal  array,  one  dimension  of  the  array  would  bn  mod  foi  each 
dlmanalon  of  the  evaluation  results.  Dictionaries  of  goal  fabric 
namaa,  goal  variable  names,  consequence  set  names ,  utility  function 
names,  and  rangu  ipeclf leal:  on  combinations  could  be  searched  Independ¬ 
ently  to  determine  each  subscript.  The  evaluation  results  would  mi 
stored  at  the  sixth  level  ut  the  array.  thin  type  of  lilu  structure 


lute  two  major  d  1  s advent ageti : 

1  -  Hu*  file  voui'i  tend  to  bo  very  spat  so 
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and  2  -  References  co  six-leyel  dynamic  arrays  In  ICETRAN  are  very 
time-consuming.  (KURT KAN  dimensioned  arrays  will  not 
accommodate  6  subscripts  in  ICES,  which  uses  the  FORTRAN 
IV  E-Level  Subset  compiler.) 

if  fewer  than  five  subscripts  are  used,  then  two  or  more 
dimensions  must  be  associated  with  a  single  subscript.  Dictionary 
searches  must  be  performed  on  combinations  of  dimensions  rather  than 
single  dimensions.  The  advantage  of  fewer  subscript®  Hes  primarily 
in  the  reduction  in  access  time  required  for  references  to  the  file 
structure. 

having  considered  the  tradeoffs  between  the  greater  dictionary 
search  times  and  chorter  data  access  times  associated  with  file 
structures  with  fewer  subscripts,  the  evaluation  file  waa  designed 
as  three  separate  arrays  with  a  maximum  of  three  subscripts  per  array. 
LVLlJlC  is  u  single  subscript  dictionary  urruy  which  contains  (goal 
fabric  nume/consequence  set  name)  pairs  which  have  been  used  in  eval¬ 
uations.  The  location  in  EVLblC  of  a  particular  goal  fabric/ 
conaerjuence  pair  corresponds  to  the  lirst  subs;  ’  it  two  throc- 
HuliHCript  arrays,  EVJ.UEK  and  LV'LDAT.  The  second  8L..*<_r'pt  J  in  EVLDL'F 
and  I, VI, DAI  la  associated  with  a  particular  (goal  variablu/utillty/rangu 
tipecl f icatlon)  triple.  The  dictionary  of  these  triples  is  maintained 
in  the  first  suven  words  of  the  EVLPKK  array.  Additional  information 
describing  the  range  of  evaluation,  the  data  class  of  the  coal  variable, 
and  the  number  of  results  generated  by  the  evaluation  is  stored  in 


I'.VI.DI.F. 
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The  meaning  of  range  codes  1R1,  IK2,  and  IR3  found  in  EVLDEF 
depends  upon  Che  data  class  of  Che  goal  variable  being  evaluated. 

Table  5.3  shows,  che  dimensions  assigned  to  IR1,  IR2,  and  IR3  for  each 
r  a  class. 

The  range  codes  can  assume,  one  of  three  values:  -1,  0,  or  +1.  A 
-1  indicates  that  a  series  of  evaluations  occurred  with  the  dimension 
represented  by  the  range  code  sec  to  EACH  of  Its  allowable  values. 
Several  evaluation  results  are  generated  whenever  an  EACH  specification 
Is  used.  Evaluation  of 


'ACCESS'  FOR  DISTRICTS  EACH 

will  cause  the  goal  variable  'ACCESS'  to  be  avaluatod  once  for  each 
district  defined  for  the  consequence  set  being  evaluated.  The  number 
of  results  generated  will  be  equal  to  the  number  of  districts  defined 
for  the  action  used  to  generate  the  consequences. 

A  0  value  for  a  range  code  Indicates  thuc  evaluation  took  place 
over  ALL  possible  values  of  the  dimension  represented  by  the  code. 
Evaluation  of 


'ACCESS'  FOR  DISTRICTS  ALL 


will  cause  the  goal  veil able  'ACCESS'  to  be  evaluated  Juul  once,  with 


all  dletriclM  considered  at  one 


inc . 
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Table  3.3:  RANGE  CODES 


Data  Claes 

IR1 

IR2 

iR3 

Link 

'from'  node 

'to'  node 

unuse 

Mode 

mode  no. 

unused 

unused 

District 

district  no. 

unused 

unused 

inteidistrict 

origin  district 
no. 

destination 
district  no. 

mode  no 
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A  +1  value  for  a  range  code  indicates  that  a  single  node,  node,  or 

district  was  specified  for  that  particular  dimension.  When  this  is  the 
9 

case,  the  number  of  the  node,  mode,  or  district  is  stored  as  Nl,  N2, 

or  N3,  depending  on  which  range  code  has  a  value  of  +1. 

When  dictionary  searchee  successfully  find  the  subscript  1  from 
EVLDIC  and  J  from  EVLDEF,  the  data  can  be  retrieved  directly  from 
EVLDAT.  The  number  of  value*  stored  for  a  given  1  and  J  is  stored 
as  NVAL  in  EVLDEF  (1,J,8).  The  location  pointed  LOC  associated  with 

each  value  In  EVLDAT  la  used  to  relate  the  value  to  the  portion  of  the 

range  of  evaluation  which  was  considered  when  that  value  was  computed. 

The  MINIHUM  and  MAXIMUM  operators  impose  another  requirement  upon 
the  evaluation  file.  The  particular  mode,  district,  link  or  route  for 
which  a  minimum  or  maximum  la  found  may  be  as  Important  to  a  decision 
maker  as  the  value  itself.  If  sn  evaluation  does  use  either  the 
MINIMUM  or  MAXIMUM  operator,  HVAL  is  stored  as  a  negative  number  In 
LVLDLK.  The  negative  value  acts  uh  a  flag  to  the  WRITE  EVALUATION 
RESULTS  command,  causing  the  location  at  which  the  value  was  found  to 
br  printed  an  well  as  Che  value  Itself. 

5 . j  Goal  Kahric  Evaluation  and  Comparison 

Iht  two  major  capabilities  implemented  during  this  research  effort 
are  the  routines  for  evaluating  goal  fabrics  and  comparing  the  results 
of  Clio  evaluations.  1'och  capabilities  employ  the  same  general  technique 

\ha  lnteruui  number  or  "machine"  number,  os  opposed  to  a  user- 
unsigned  number. 


-125- 


in  terms  of  communication  between  the  Command  Definition  Language  (CDL) 
programs,  which  process  the  user  commando,  and  the  ICETRAN  programs 
which  perform  the  file  retrieval  and  computations.^ 

Both  evaluation  and  comparison  of  goal  fabrics  are  structured  as 
a  general  command  followed  by  a  series  of  subcommands .  The  general 
commands  (EVALUATE  COAL  FABRIC  'snarne'  and  COMPARE  GOAL  FABRIC  'gname') 
simply  initialize  the  computational  routines  and  inform  them  that  goal 
fabric  'gname'  is  to  be  used.  Subsequent  subcommands  perform  different 
tasks  which  are  part  of  the  total  computation.  The  tasks  specified  by 
subcommands  in  the  evaluation  of  a  go a'  fabric  are  the  following: 

1.  Specify  a  new  utility  function 

2.  Specify  a  new  goal  variable  to  be  evaluated 
Subcommands  in  the  compariaon  procedure  are  used  for  the  following 
teaks: 

1.  Specify  a  baae  file 

2.  Specify  a  aet  of  actions,  parameter*,  consequences,  or 
utilities  over  which  a  comparison  is  to  be  performed 

3.  Specify  the  oraor  in  which  values  of  the  goal  variable  are 
to  be  ranked 

i*  Specify  the  goal  variable  and  range  of  evaluation  whose 
results  are  required  for  the  comparison. 

Communication  between  CDL  and  the  ICETRAN  routines  is  accomplished 
by  netting  switches  In  tire  COMMON  area  (an  area  addressable  by  all 

^,JSuo  reference  number  5,  ICES  Programme  re  Reference  Manual,  for  a 
description  of  the  CUE  and  ICETRAN  languages. 
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ICETRAN  and  COL  programs).  When  a  subcommand  Is  processed,  a  switch 
Is  sec  to  an  appropriate  value  and  the  ICETRAN  computational  routines 
are  called.  The  ICETRAN  routines  i.^ine  the  switches  to  determine 
which  subcommand  has  been  given  and  take  the  appropriate  action. 

5.6  Error  Checking 

Every  attempt  has  been  made  to  detect  errors  by  the  analyst  when 
using  the  new  capabilities  described  here.  The  frequent  communication 
between  CDL  and  the  ICETRAN  programs  facilitates  error  checking  st 
Intermediate  points  during  the  evaluation  and  comparison  procedures. 

When  an  error  Is  detected,  a  message  indicating  the  nature  of  the 
error  Is  printed.  Subsequent  commands  which  depend  upon  the  successful 
execution  of  the  command  in  which  an  error  was  found  are  ignored. 
Processing  la  resumed  as  soon  as  a  command  is  encountered  which  does 
not  depend  on  command*  previously  processed. 

The  philosophy  of  error  checking  differs  for  systems  designed  to 
operate  in  a  time-sharing  computer  environment  as  opposed  to  a  batch 
processing  environment.  The  analyst  using  u  time-sharing  system  can 
correct  errors  on-line  that  could  not  be  corrected  in  a  batch  processing 
computer  run.  Since  UODOTRANS  operates  succeesfulJy  in  both  time¬ 
sharing  and  batch  processing  computer  systems,  the  error  checking 
philosophy  used  in  developing  new  capabilities  is  intended  to  give 
satisfactory  response  to  users  in  both  envl*  -ieuts. 


filoic 
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AUI.  3  U8ARHAYS  ARE  DOuBlE  WORD  GROWING  ARRAYS 


FI  ‘.nu  VI  Hi  .•  t  loiiiirv  of  iMi/i  riles 


NOTE 


-128- 


are  DOUBLE  WORD  ARRAYS 


II CUKE  Contents  of  'lie  Dictionaries 


FULL  WOH05 
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DOuaiE  WORDS 

t 

GROWING 


FIGGKE  5.5:  Dictionary  of  Evaluations 
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FIGURE  b.  6: 
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FIGURE  S.7:  Evaluation  Data  File 
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CONCLUSIONS 


6. 1  Introduction 

This  chapter  contains  e  discussion  of  the  conclusions  that  were 
made  on  the  basis  of  this  research.  The  conclusions  are  based  upon 
an  evaluation  of  the  effectiveness  of  the  capabilities  that  nave  been 
implemented  for  the  evaluation  and  comparison  of  alternative  transport 
sys:ems.  Included  are  recommendations  for  improvements  and  extensions 
to  the  new  capabilities  that  would  enhance  their  effectiveness  as 
evaluation  tools. 

6. 2  Evaluation  of  New  Capabilities 

6.2.1  Coal  Fabric  Definition 

The  DODOTRANS  user  has  greater  flexibility  in  the  definitions  of 
goal  fabrics  than  did  the  DODO  user.  The  number  of  types  of  basic 
consequence  data  available  for  goal  variable  definitiona  has  increased 
from  five  items  in  DODO  to  over  25  items  in  DODOTRANS.  The  most  useful 
new  data  types  appear  to  be  the  link  travel  times,  speeds,  and  volumes, 
and  the  accessibilities  by  district  and  by  mode. 

The  quotient  and  sum  operators  also  Increase  the  flexibility  of 
the  goal  variable  definition  procedure.  The  sum  operator  Is  especially 
important  because  it  makes  possible  the  definition  of  a  goal  variable 
as  a  linear  scoring  function. 

6.2.2  Utility  Function  Definition 

Utility  functions  are  necessary  components  in  an  evaluation 
procedure  because  they  provide  a  method  for  the  analyst  to  express  a 
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statement  of  preferences.  The  capability  implemented  in  Chit 
research,  namely,  a  vector  of  constant  utilities  which  operate  upon 
the  operands  of  a  goal  variable  during  evaluation,  is  the  moat  basic 
form  of  utility  function.  It  is  exceedingly  useful  for  conducting 
parametric  analyses  on  the  utility  of  a  given  impact  when  a  linear 
scoring  function  is  used  to  combine  several  different  Impacts. 

The  necessity  of  defining  a  utility  for  ail  goal  variables  prior 
to  their  evaluation  does  have  one  disadvantage.  Many  goal  variables 
require  a  utility  function  with  all  weights  equal  to  unity.  At 
present  the  analyst  has  to  define  these  null  utilities.  A  convention 
could  he  defined  whereby  a  special  utility  function  name,  e.g.  'UNIT', 
was  made  available  to  the  analyst  to  use  whenever  a  null  utility  of 
any  dimension  was  required.  This  would  eliminate  the  need  for  the 
analyst  to  define  these  utilities  in  every  analysis. 

6.2,3  Goal  Fabric  Evaluation 

The  evaluation  procedure  ie  essentially  the  same  in  DODOTRANS  as 
in  DODO  with  respect  to  the  external  command  specifications.  The 
differences  are  1)  a  utility  function  must  he  specified  prior  to 
evaluation  of  a  goal  variable,  and  2)  the  range  of  evaluation  has 
several  different  forms,  depending  upon  the  data  class  of  the  goal 
variable  being  evaluated. 

A  significant  improvement  hao  been  made  internally  in  the 
evaluation  procedure  by  the  addition  of  an  evaluation  file  which 
contains  the  results  of  all  evaluations  performed  during  an  analysis. 
The  creation  of  this  file  facilitated  the  development  of  the  comparison 


procedure. 
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6.2.4  Goal  Fabric  Comparison 

The  goal  fabric  comparison  commands  provide  Che  DO DOT RAH S  user 
with  a  capability  that  appeared  in  a  very  rudimentary  form  in  DODO. 

The  structure  of  the  command  language,  consisting  of  numerous  sub¬ 
commands  preceded  by  a  general  command,  permits  the  analyst  to 
establish  a  number  of  basic  quantities  needed  for  Li,  ■  computation  of 
the  comparison  results,  namely:  base  data  files,  a  comparison  set, 
and  a  preferred  ranking  order.  He  can  then  conduct  comparisons  on  the 
values  of  a  series  of  goal  variables,  subject  to  those  base  quantities, 
by  specifying  only  the  goal  variable  name  and  the  reage  of  evaluation. 
The  basic  quantities  are  not  specified  again  for  subsequent  evaluations 
unless  a  change  occurs  in  one  of  the  basic  values. 

The  ability  to  perform  a  comparison  over  sets  of  actions,  param¬ 
eters,  consequences,  and  utilities  facilitates  sensitivity  analysis 
on  variables  which  are  subject  to  uncertainty  during  the  prediction 
and  evaluation  procedures.  In  particular,  parametric  analysis  of  the 
demand  parameters  and  the  assumed  utilities  are  accomplished  in  an 
efficient  manner  by  comparing  goal  variables  over  sets  of  parameters 
and  utilities,  respectively. 

The  comparison  of  goal  variable  USERCOST  did  suggest  one  manner 
in  which  the  comparison  procedure  might  be  expanded.  Notin;;  that  the 
most  interesting  information  obtained  from  that  comparison  was  a  change 
in  the  ranking  of  total  user  cost  by  mode  as  the  value  of  travel  time 
was  changed,  an  extension  of  the  sat  capability  to  include  sets  of 
modes  would  facilitate  rankings  of  this  type.  Similarly,  an  argument 
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could  be  made  for  the  addition  of  sets  of  links,  districts,  and  routes 
to  the  comparison  capability. 

6.2.5  Output  of  Evaluation  File 

The  WRITE  EVALUATION  RESULTS  command  was  intended  to  provide  a 
means  for  the  analyst  to  look  at  a  portion  of  the  evaluatlcn  file  in 
a  relatively  unstructured  manner.  A  simple  tabular  listing  is 
generated  in  which  the  only  structure  comet  from  the  fact  that  the 
results  are  grouped  by  goal  variable  and  by  utility  function.  The 
capability  has  proved  to  be  more  useful  than  anticipated,  however, 
because  it  complements  the  comparison  procedure  when  the  goal  variable 
being  compared  Is  defined  with  the  maximum  or  minimum  operator.  The 
location  of  each  value,  i.e.  the  specific  link,  mode,  district,  or 
route  for  which  it  was  found,  is  not  printed  as  part  of  the  display 
generated  by  the  compare  command  when  a  minimum  or  maximum  goal 
variable  is  analyzed.  The  location  is  omitted  in  order  to  keep  the 
display  simple  and  understandable.  If  the  analyst  wishes  to  know  the 
location  of  a  value  or  values  for  a  goal  variable  representing  a  minimum 
or  maximum,  the  WRITE  EVALUATION  RESULTS  command  provides  the  capability. 

6.2.6  Information  Retrieval  Routines 

The  routines  for  generalized  information  retrieval  added  to 
DODOTRANS  as  part  of  this  research  are  useful  for  several  reasons: 

1.  They  extend  the  definition  of  goal  variables  to  include  link, 
mode,  and  district  data  as  well  as  interdistrict  data. 

2.  They  provide  access  to  the  data  required  for  the  development 
of  a  general  graphic  display  capability. 
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3.  They  can  be  used  Co  provide  a  general  interface  between  the 
D01X3TRANS  data  files  and  analytical  procedures  such  as 
statistical  analysis  routines. 

4.  Their  modular  structure  facilitates  the  addition  of  new  data 
classes,  created  by  the  addition  of  new  models  or  expansion 
of  existing  models,  to  all  of  the  current  evaluation  and 
comparison  capabilities. 

6. 3  Recommendations  for  Expansion  or  Modification  of  hew  Capabilities 
6.3.1  Goal  Fabric  Definition 

The  definition  of  goal  fabrics  could  be  improved  by  expanding  the 
types  of  operators  available  for  goal  variable  definitions.  The  product 
and  quotient  operators  might  be  modified  to  operate  upon  more  than  two 
operands. 


,gcal1'  -  A*B*C*D 
'goal2'  -  E/V/C 

A  more  useful  extension  would  permit  combinations  of  operators  to  be 
used  in  goal  variable  definitions. 

'goal3'  -  A  +  11/ C  -  D*E 


'goal^'  -  Min[F*G/H] 
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All  of  the  forms  of  definition  noted  above  could  be  generated  with 
the  existing  operators  if  goal  variables  were  used  as  operands  in  the 
definition  of  higher-order  goal  variables.  The  definition  of  'goal^' 
could  be  generated  using  existing  operators  as  follows: 

' goalj'  -  F*G 
' goalg'  -  (' goalj' )/H 
' goal^’  ■  Mint '  goal^' ] 

The  goal  variable  definition  and  evaluation  routines  were  designed 
with  the  knowledge  that  goal  variables  might  be  used  as  operands  In  a 
recursive  form  of  definition  in  future  versions  of  DODOTRANS.  The 
addition  of  goal  variable  operands  to  the  coded  definitions  of  goal 
variables  is  a  simple  task.  The  major  difficulty  in  implementing 
the  recursive  goal  variable  definition  capability  is  the  specification 
of  the  range  of  evaluation  for  a  goal  variable  operand.  Unlike  basic 
operands,  the  values  of  goal  variable  operands  are  not  stored  in  a 
file  that  is  referred  to  by  specifying  a  set  of  links,  modes,  districts 
or  routes.  Values  of  goal  variables  are  stored  in  an  evaluation  file 
in  which  complete  identification  requires  specification  of  the  follow¬ 
ing  items: 


1.  Goal  Fabric 

2.  Consequence 

3.  Utility  Function 


4. 


Range  of  Evaluation 
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Coal  variables  which  uaa  othar  goal  variables  aa  operand*  cannot 
b*  evaluated  until  a  range  of  evaluation  Is  created  which  reconcllea 
the  specif  lost! ona  Hated  above  with  the  standard  rang*  specif lcatlona 
used  for  belle  operands.  In  short,  goal  variable  operands  represent 
a  new  data  class,  Xt  differs  fro*  other  data  clauses  in  that  it  la 
desirable  to  combine  goal  variable  operands  in  the  same  definition  with 
operands  from  the  four  orlginal  data  classes.  Coablnlng  goal  variable 
operands  and  basic  operands  in  a  single  definition  requires  the 
specification  of  e  single  range  of  evaluation  that  will  accommodate 
both  operand  types. 

Xsgardleae  of  the  difficulty  of  implementation,  the  recursive  goal 
variable  definition  capability  would  greatly  Increase  the  power  of  the 
goal  fabric  concept  in  PObOTKAMS. 

Utl  1  lty_  runcXJLvn .Piflnltlgn 

Saverel  recommendatlone  concerning  the  definition  of  utility 
(unctions  hevo  been  suggested  by  thie  research.  The  first  concerns 
the  possibility  of  relieving  the  analyst  of  the  task  of  defining  unit 
utility  vectors  by  providing  •  atandaid  utility  which  could  be  speci¬ 
fied  whenever  an  n-dlmansionnl  unit  utility  was  required  (for  any 
value  of  n). 

The  constant  weights  provided  by  the  current  capability  could  be 
axpanded  In  many  ways.  The  weights  might  be  expanded  to  include  s 
coefficient  and  an  exponent  so  that  any  n-in  degree  polynomial  could 
ba  established  as  a  goal  variable.  4  goal  variable  of  the  general  form 
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k  x 

'goal?'  ■  X]  cy  (Operand  ]  1 
i-1 

might  be  defined  using  a  sum  operator  and  a  utility  function  which 
Include  k  pairs  of  weights  (c^.x^.  This  form  of  definition  could  be 
implemented  with  very  little  modification  of  the  existing  programs. 

The  greatest  cask  would  be  to  modify  the  evaluation  routine  to  Include 
an  exponanc  for  each  operand  in  the  computation  of  a  goal  variable 
which  uses  the  sum  operator. 

Another  extension  of  the  utility  function  capability  would  be  to 
define  weights  es  stop  functions  which  assume  diecrete  values  over 
verlous  ranges  of  the  operand  being  modified.  This  fern  would  be  more 
difficult  to  implement  than  the  extended  polynomial  form  outlined 
ebova,  The  evaluation  process  would  have  to  examine  each  operand  and 
determine  which  range  its  value  was  In  so  that  a  value  could  be  assigned 
to  the  utility. 

lhe  most  general  form  of  utility  function  would  be  a  user-supplied 
('OUTRAN  program  which  computed  the  value  of  a  utility  given  the  value 
of  an  operand  during  the  evaluation  procedure,  this  form  uf  utility 
would  be  the  moat  difficult  to  use  from  the  user's  viewpoint,  because 
lie  would  be  inquired  to  write  end  store  a  FORTRAN  routine  in  a  specified 
manner  prior  to  performing  any  evaluation#  with  the  new  utility 
function.  This  Is  true  because  one  cannot  Interface  directly  with 
KURTRAi'J  from  an  1CKS  problem-oriented  language  such  as  DODOTRANS. 

Further  analyses  should  he  conducted  with  the  existing  utility 
(unction  capability  to  determine  which  functional  forms  would  be  most 
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uaeful  in  transport  systems  analysis  before  any  major  software  changes 
are  made. 

6.3.3  Goal  Fabric  Evaluation 

The  evaluation  of  goal  fabrics  could  be  improved  if  more  than  one 
consequence  could  be  specified  in  the  general  command.  The  VTOL 
example  required  repetition  of  the  evaluation  procedure  11  times 
whenever  new  goal  variables  were  evaluated.  An  optional  set  name  might 
be  specified  in  the  general  command  which  contained  the  names  of 
several  consequences.  Goal  variables  specified  with  the  use  of  goal 
variable  subcommands  would  be  evaluated  for  each  consequence  in  the 
set. 

6.3.4  Goal  Fabric  Comparison 

The  extension  of  che  comparison  set  capability  to  include  sets 
of  modes,  districts,  routes,  and  links  has  already  been  mentioned  as 
a  recommendation  for  further  development. 

The  other  extension  of  the  comparison  capability  which  would  be 
of  u»e  to  the  analyst  in  the  option  of  automatically  evaluating  a  goal 
variable  whenever  a  value  was  requested  which  had  not  been  computed. 

If  thla  modification  were  implemented,  it  should  be  an  option  which 
can  be  used  at  the  discretion  of  the  analyst.  This  will  provide  the 
analyst  with  control  over  the  number  of  evaluations  performed  during 
an  analysis.  The  option  could  be  specified  as  another  subcommand 
during  the  comparison  procedure,  similar  to  the  rank  order  subcommand. 

6.3.5  Additional  Output  Commands 

The  existing  evaluation  and  comparison  capabilities  could  be 
Improved  by  the  addition  of  oilier  forms  of  output.  A  command  which 
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lists  the  complete  definition  of  a  goal  variable  or  an  entire  goal 
fabric  would  allow  an  analyst  to  review  the  goal  variables  which  he 
had  defined  in  earlier  runs. 

Another  useful  command  would  list  all  appearances  of  a  goal 
variable  in  an  evaluation  file.  The  listing  should  Include  the  con¬ 
sequence,  utility  and  range  specification  associated  with  every 
appearance  of  the  goal  variable  in  the  file. 

6.3.6  Disk  Storage  of  Evaluation  rile 

The  arrays  comprising  the  evaluation  file  should  be  saved  along 
with  the  rest  of  the  DODOTRANS  data  structure  when  the  SAVE  OPERATION 
command‘d  is  used.  This  must  be  done  so  that  the  results  of  evalua¬ 
tions  performed  in  one  run  can  be  analyzed  in  subsequent  runs. 

6.3.7  Specification  of  the  Range  of  Evaluation 

The  current  goal  fabric  evaluation  and  comparison  capabilities 
require  that  the  range  of  evaluation  must  be  stated  each  time  that  a 
goal  variable  is  evaluated  or  compared.  This  requirement  stems  from 
the  fact  that-  the  definition  of  a  goal  variable  does  not  include  a 
statement  of  the  range  of  evaluation.  This  decision  was  made  because 
It  was  noted  that  a  single  goal  variable,  defined  as  an  operator  and 
a  number  of  operands,  might  be  evaluated  over  many  different  ranges 
in  the  course  of  an  analysis.  The  goal  fabric  would  contain  a  great 
many  more  goal  variables  if  the  definition  were  extended  to  include 
the  range  of  evaluation.  It  Is  true,  however,  that  the  necessity  of 
specifying  the  range  of  evaluation  during  the  evaluation  and  comparison 

11See  the  DODOTRANS  Users'  Manual 
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of  goal  fabrics  makes  the  command  language  more  cumbersome  to  the 
analyst.  An  argument  for  the  inclusion  of  the  range  of  evaluation 
in  the  goal  variable  definition  might  be  made  on  this  basio. 
Insufficient  use  has  been  made  of  the  existing  capabilities  to  make 
a  firm  recommendation  for  or  against  this  modification.  It  is  men¬ 
tioned  here  only  to  point  out  the  fact  that  a  relative  arbitrary  design 
decision  was  made  which  may  prove  to  have  been  unwise  as  more  extensive 
use  is  made  of  tne  new  capabilities. 

6.3.8  Shorthand  Notation  for  the  Range  of  Evaluation 

A  shorthand  command  notation,  similar  to  the  EACH  capability, 
might  be  implemented  which  would  further  reduce  the  number  of  commands 
required  to  evaluate  a  goal  variable  over  several  ranges.  A  range 
specification  called  EVERY  could  be  defined  which  would  specify  that 
a  goal  variable  was  to  be  evaluated  over  all  posalble  ranges.  For 
example,  the  evaluation 

' BTLENECK'  FOR  EVERY  RANGE 

might  compute  the  same  number  of  results  as  the  commands 

'BTLENECK'  FROM  NODES  EACH  TO  NODES  EACH 
'BTLENECK'  FROM  NODES  ALL  TO  NODES  EACH 
'BTLENECK'  FROM  NODES  EACH  TO  NODES  ALL 


'BTLENECK'  FROM  NODES  ALL  TO  NODES  ALL 
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Evaluation  over  every  range  as  defined  above  requires  n  commands 
for  a  goal  variable  which  has  n  dimensions  Co  its  range.  Therefore, 
use  of  the  EVERY  specification  with  an  interdistrict  goal  variable  (3 
dimensions)  would  result  in  a  savings  of  eight  (n^  -  1)  commands 
compared  to  the  current  capability.  Howeve . ,  before  a  capability  such 
as  EVERY  is  implemented,  it  should  be  determined  that  the  resulting 
ranges  of  evaluation  are  meaningful  and  useful. 

6.3.9  Generalized  Graphical  Display  Capgblllty 

The  goal  variable  definition  and  evaluation  routines  Include  a 
flexible  capability  for  the  retrieval  and  manipulation  of  a  variety  of 
data  generated  by  the  UODOTRANS  system  of  predictive  models.  These 
information  retrieval  capabilities  could  be  used  for  the  addition  of 
generalized  graphical  display  capabilities.  The  greatest  single 
problem  in  designing  general  graphics  programs  is  the  retrieval  of  a 
variety  of  types  of  data  and  conversion  of  that  data  into  a  standard 
form  which  can  be  converted  to  coordinates  for  display.  The  informa¬ 
tion  retrieval  routines  in  DODOTRAiNS  were  designed  in  part  to  aid  in 
the  solution  of  this  problem. 

6.3.10  Statistical  Analysis  of  Impact  Data 

The  inclusion  of  statistical  analysis  routines  such  as  multiple 
regression  and  analysis-of-variance  techniques  would  aid  the  analyst 
in  recognizing  functional  relationships  and  trends  in  a  set  of  Impact 
data.  For  example,  the  frequency  of  service  over  a  series  of  routes 
could  be  compared  with  the  average  travel  time  over  each  route  for  a 
given  mode  to  see  if  a  well-defined  relationship  exists  between  the  two 
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quantities.  The  tradeoff  analyses  performed  In  the  Prototype  Analysis 
to  determine  combinations  of  fares  and  frequencies  of  service  which 
generated  a  given  level  of  demand  could  be  analyzed  with  analysia-of- 
varlance  methods  to  see  how  well  the  demand  could  be  estimated  in 
terms  of  fare  and  frequency  of  service.  The  Information  retrieval 
routined  added  to  DODOTRANS  would  facilitate  the  implementation  of 
other  analytical  procedures  into  the  evaluation  process. 

6. 4  Su  tanary 

The  EUDOTRANS  language  is  a  comprehensive  planning  tool  which 
permits  a  user  to  analyze  alternative  transport  systems.  The  comparison 
and  evaluation  of  predicted  impacts  are  integral  steps  in  the  analytical 
process.  The  research  described  here  has  focused  upon  the  extension 
and  improvement  of  the  techniques  in  DODOTRANS  for  evaluation  and 
comparison  of  inpactB  in  an  effort  to  determine  the  best  alternative 
for  implementation  in  the  real  world.  The  evaluation  techniques  in 
DODOTRANS  do  not  select  the  best  alternative  action  for  Implementation, 
however.  The  final  decision  to  accept  the  best  action  found  thus  far 
or  to  request  the  generation  of  new  alternative  actions  must  be  the 
responsibility  of  the  decision-maker  alone.  The  DODOTRANS  language  is 
designed  to  provide  a  methodology  which  aids  the  decision-maker  in 
comparing  the  performance  of  several  alternative  actions  with  respect 
to  the  preferences  of  relevant  actors  in  the  system. 
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